Do all the things like ++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatarSign Up
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple APILearn More
Search - "cloud backup"
Today my manager asked me about my research into using RabbitMQ as a backup in case Azure Service Bus ever goes down.
Me: "Good. The way we designed the framework, all we have to do is drop the DLLs into the directory, update the config, and the services will start using RabbitMQ."
Mgr: "Excellent. Probably should be looking into using RabbitMQ as a permanent replacement for Azure"
Me: "What? The whole reason we moved to Azure was to eliminate the problems with having an on prem service bus. Since we've switched, there has been zero downtime."
Mgr: "That's what VP-Joe is afraid of. If Azure ever goes down, he won't know how to explain Azure to the president as to why we're not taking orders or can't ship packages."
Me: "That makes no sense. What did VP-Joe tell the president when a database goes down or a server mis-configuration?"
Mgr: "President understands internal outages, its just the whole 'cloud' thing he doesn't understand."
Me: "Um..then VP-Joe needs to explain it to him?"
Mgr: "The decision has already been made. Are you on board? Lets look at this move as a cost savings."
Me: "You mean the $10 a month? How much hardware will we need to support RabbitMQ?"
Mgr: "Yea, nobody probably thought of that."
Me: "I'm on board with whatever decision, but I'd like a little more than VP-Joe being afraid of the president."
Mgr: "I'm sure its not being afraid."
Mgr: "OK, lets wait and see if VP-Joe forgets about this and moves on to something new."5
Had this with a relative. His laptop wasn't turning on, with or without charger so he brought it back to the store to fix it. It ran elementary os by the way (detail for later). Then he got it back after a week and we booted it and it had windows 8 installed (wtf indeed). So we called the service desk to ask about it since the issue was a broken charger (!!!). Their reply: oh yeah there was a weird system installed on it so we thought we'd reset it as well for you.
SERIOUSLY, THAT'S NOT YOUR FUCKING JOB!!
He is not tech savvy and he didn't know much about backups so that was literally about one year of work GONE. Yeah, I setup a cloud backup sync thingy for him right after that.7
Had a stack of harddrives with my important data, two USB drives and a 4.7gb disc, two or three cloud storage accounts.
Needed a restore:
Knocked the stack of hard drives onto the floor (all broken), stood on one of the flash drives, found the other one in a pocket of a pair of trousers which just came out of the washing machine, dvd too scratched to read and couldn't verify my cloud storage account because I lost the password to the connected email account and the backup email account to verify that one didn't exist anymore. Fucking hell.
Production database with not that much yet but at least some production data which wasn't backupped.
Friend: can I reboot the db machine?
Friend: what's the luks crypt password?
End of story 😅
For the record, the first one actually happened (I literally cried afterwards) and that taught me to update my recovery email addresses more often!9
TLDR: First dinner with whole family, already 3 smartphones to "repair".
They buy cheap phones with just 8 GB of storage and then ask me to solve their issues with "insufficient space on the device" without removing pictures and videos because of course they are not aware of concepts like pc/cloud backup or using SD card as main saving location.
At least these phones are full of bloatware so I can easily disable something to gain enough storage to get rid of the notification (tricking them into believing that I solved all of their problems) while I set SD card as default and enlighten them about the wonders of Google Photo and its auto-clean function.
I'd really like to ignore them, but unfortunately that's the only kind of relationship I have with my relatives, I know that sucks but at least is something.
And I actually prefer to spend some minutes on someone else's phone than talk about politics or try to explain what exactly is my job and what I am studying 🙄6
Recently I got into contact with the supplier of that 500W power supply that I've been servicing earlier, as I lost my pictures of the disassembly process with that craptacular Nexus 6P (didn't back them up.. terrible sysadmin, am I not?) and wanted to get the circuit diagrams of this thing in order to repair it. Sales girl wanted to give it to me but she'd have to ask the factory people.. and of course those people denied. As if I wanted to use this for anything but to repair my own bloody unit.. pieces of shit.
So I started considering buying a second one, in order to repair my current supply that I've already spent half a week on to document its components, desolder it, clean it up and resolder it (and replace some resistors here and there with better ones from my own assortment). And the project had to be paused because I lost the stupid pictures and couldn't for the love of God figure out how there's supposed to be a jumper near BD2.
Just now going through my notifs..
"Someone ++'d your rant!"
A rant that I completely forgot about.. https://devrant.com/rants/1757297. It's a perfect picture of the supposed jumper near BD2 that I was scratching my head about for so long. Turns out that it's just a dupe of the LF2 lines that I erroneously wrote down twice. DevRant, it's good for more than just venting, haha! Time to restore from a cloud backup XD4
Fucking cloud providers always trying to steal your shit and spy on your things, fucking prying eyes. That's why i've decided to go back hosting my own private cloud from home. Running on some very energy efficient shit: dual core intel atom cpu (so slow that it can't fucking run windows normally), 16gb of ram, because why the fuck not? and 1tb 2.5"hdd, along with unlimited data - 100/100 Mbit/s internet connection with a server response time less than 95ms just to backup my shitty Iphone selfies and cat pics, host some very important files and regularly back up my contacts. This shit runs CentOS, Nginx, https, bitch! This platform is more trustworthy than your shitty dropbox or whatever other shit they offer you. I can choose whether i back-up my shit from local network or over internetz, Costing me no more than 25€ annually(just to keep the machine on 24/7/365).14
Who else agrees that the play store should have a section which tells if an app needs a mandatory login to use it ? Like why the hell does a simple offline planner todo app need you to sign-up if you don't wanna use cloud backup. Jeez the user just trusted you by spending valuable time and bandwidth downloading your app. You owe it to him to show him some features of the app before shoving a sign up in his face. As an app developer myself I really think that this kind of behaviour turns off more users than anything else.2
I took this contract and made the suggestion that we backup to the cloud and create a private repo on GIT. Client said no, local should be fine, they don't want someone stealing their code. I said okay fine.
AC just went out in the server room and they apparently had a leak from the AC to the power supply which they happened to put on top of the rack servers and switches. I'm surprised that place didn't catch fire, might be to early to call it.
All this on a Friday and we were 2 weeks away from launch party.
Not my fault, I clearly said we backup to cloud and use GIT on private repo.3
One of my hard drives S.M.A.R.T. said it could fail anytime and I should backup my data. I cut all the files to a new hard drive.
Later that week the new drive fails with the needle falling into the magnetic disks... Fml.
Should've saved those files on the cloud...13
This day I have received the most glorious news in e-pistolary form. For some years, I was suffering in support of a client who was, well, insufferable. My presence there paralleled the divine comedy in both essence and fact.
I opened the missive, expecting another plea to bail them out of whatever clusterfuck they found themselves in. Instead, what I found was something truly magical.
I hope this finds you well. I'm not sure if you remember a few years back, we were trying to decide between IBM Cloud and AWS. Well, after years of battling FF*, we're finally moving ahead with AWS. He failed one too many times to deliver anything visibly. After you left, there was no one left he could use to steal credit, ideas, and work.
FF is still pushing to have them use IBM cloud as a "warm backup" in the event "AWS fails." We will see where that goes.
I figured you'd like to know; you were the void in the wilderness for a long time. I don't want to think about how much time we could have saved if we had just listened.
This event represents a personal victory, albeit belated, over a few peoples' absurd amount of privilege. Towards the end, I was vicious about my contestation to the insanity of adopting a desperate hedge attempt-as-cloud offering from a failing company. Some examples:
// cloud 'strategy meeting'
Moi: What cloud platform are we looking at using?
FF: We're looking at IBM cloud and AWS as a second.
Moi: Why is that? I understand you're obligated to rep your offering first, but that decision doesn't seem to have the customer's best interest at heart.
FF: IBM cloud is a market leader; AWS isn't as good.
Moi: I see. I mean, that's the tech equivalent of the company's fleet management considering monkeys on tricycles as a strong competitor to service trucks, but I get what you mean.
// steering meeting
Director: Who can we look to as an example? Who is currently using the IBM cloud?
Moi: No one; they account for a single-digit portion of the actual cloud market. Their long game to sell you a "Hybrid Cloud," which means put some front end payload in a CDN, and buy n-frame units of IBM z servers for the DC with IBM gateway appliances acting as connective tissue. So it's not the cloud at all, really.
Director: How does it compare in cost?
Moi: It's generally 40% more expensive than other clouds, and it only goes higher as you option their software.
Director: What about Watson? I hear Watson is good?
Moi: It's a brand name. Most of the "Watson" product is just a facade on top of FOSS products like Spark, Hadoop, Elasticsearch, etc.
Director: Those were words. They sounded good. FF say it's good tho so we'll believe him because we're from the same city.
Moi: *deletes Director from LinkedIn*
Moral of the story: Never trust a vendor that only recommends their products.
*FF = FatFuck - an embarrassingly rotund individual whose girth is roughly equivalent to his height. He shit his way into an IBM architect position in his mid-20s purely due to winning the visa lottery. He had fake hair glued to his head for his wedding to hide his male pattern baldness; his arrange-married wife undoubtedly cries herself to sleep after sex.
**PeeEm - the then project manager, now portfolio manager of some satellite projects. An overall decent human being, capable.10
I really enjoy my old Kindle Touch rather than reading long pdf's on a tablet or desktop. The Kindle is much easier on my eyes plus some of my pdf's are critical documents needed to recover business processes and systems. During a power outage a tablet might only last a couple of days even with backup power supplies, whereas my Kindle is good for at least 2 weeks of strong use.
Ok, to get a pdf on a Kindle is simple - just email the document to your Kindle email address listed in your Amazon –Settings – Digital Content – Devices - Email. It will be <<something>>@kindle.com.
But there is a major usability problem reading pdf's on a Kindle. The font size is super tiny and you do not have font control as you do with a .MOBI (Kindle) file. You can enlarge the document but the formatting will be off the small Kindle screen. Many people just advise to not read pdf's on a Kindle. devRanters never give up and fortunately there are some really cool solutions to make pdf's verrrrry readable and enjoyable on a Kindle
There are a few cloud pdf- to-.MOBI conversion solutions but I had no intention of using a third party site my security sensitive business content. Also, in my testing of sample pdf's the formatting of the .MOBI file was good but certainly not great.
So here are a couple option I discovered that I find useful:
Solution 1) Very easy. Simply email the pdf file to your Kindle and put 'convert' in the subject line. Amazon will convert the pdf to .MOBI and queue it up to synch the next time you are on wireless. The final e-book .MOBI version of the pdf is readable and has all of the .MOBI options available to you including the ability for you to resize fonts and maintain document flow to properly fit the Kindle screen. Unfortunately, for my requirements it did not measure-up to Solution 2 below which I found much more powerful.
Solution 2) Very Powerful. This solution takes under a minute to convert a pdf to .MOBI and the small effort provides incredible benefits to fine tune the final .MOBI book. You can even brand it with your company information and add custom search tags. In addition, it can be used for many additional input and output files including ePub which is used by many other e-reader devices including The Nook.
The free product I use is Calibre. Lots of options and fine control over documents. I download it from calibre-ebook.com. Nice UI. Very easy to import various types of documents and output to many other types of formats such as .MOBI, ePub, DocX, RTF, Zip and many more. It is a very powerful program. I played with various Calibre options and emailed the formatted .MOBI files to my Kindle. The new files automatically synched to the Kindle when I was wireless in seconds. Calibre did a great job!!
The formatting was 99.5% perfect for the great majority of pdf’s I converted and now happily read on my Kindle. Calibre even has a built-in heuristic option you can try that enables it to figure out how to improve the formatting of the raw pdf. By default it is not enabled. A few of the wider tables in my business continuity plans I have to scroll on the limited Kindle screen but I was able to minimize that by sizing the fonts and controlling the source document parameters.
Now any pdf or other types of documents can be enjoyed on a light, cheap, super power efficient e-reader. Let me know if this info helped you in any way.4
Tfw you accidentally chmod'ed the entire root of your cloud server, because you've misplaced a "/".. Thank god, that there is such a thing called a 'backup'.
The amount of sweat and stress I had when the SSH disconnected and I couldn't log back in, the Apache and MySQL services that began to throw failures..
It's on moments like this, that you really appreciate the 24/7 customer-support! 😂
And all this while I was at my job, working for another company..
Alright... I just delete my work laptop. Accidentally.
I am working on a framework where you have to delete a tmp directory. So I wrote a script to delete it and bound it to a shortcut. Well... I adjusted the script to a different project and hit it... Suddenly my home directory was gone...
And even worse. It synchronised it to the cloud drive where our shared directory is...
Well... fuck... Luckily I could restore the cloud drive from the browser... Now just to restore my laptop.
Normally I'd say I just have my backup back on it... Well, the backup is two weeks old and is at the company. Disadvantages of working from home. And I have a few credential files on it I don't want to lose. The rest is all secure in git.
Well.. let's try extundelete.. Wish me luck.2
Me and my friend were having a coffee in a coffee shop and then she told me the story of how she got fired.
So back then storing data on cloud was not that convenient and employees in her company used to carry softwares and other stuff in pendrives.
This one day after completing a MAJOR project for a very irritating client, my friend and her team decided to take the day off and celebrate this victory in a pub.
She got drunk and then came the call of her boss saying that they needed to showcase the software right then to the client.
Being always responsible and committed to her work my friend had decided to keep a backup in her pendrive which she kept in her breast pocket of her shirt.
So she goes into the washroom to freshen up, bends down near the toilet to vomit out liquor and lo!
The pendrive slid all the way down from her pocket into the toilet sink.
She didn't notice and flushed and down went the whole project into the sewer.
Moral - life fucks you in ridiculous ways.
Ps. She left her laptop at her home which was very far from her office and the pub. The team had to go to her home first to retain the project and eventually got seriously late. Boss didn't like it as the client was a real pain in the ass and this was a big project too and being the team lead my friend was supposed to deliver as expected.
She got fired.1
So I spent over 200 hours recovering a raid array because the the business that hired the company I work for tried to do all the work in house. Now I'm to the point of trying to quote a new server setup to the company because the last one got hit by lightning. My quote $8000-$20000 in just hardware alone. If im going to do this I want to do it right. Twin servers running xenserver holding virtual machines with a high-quality Nas to hold the virtual machine. Then have the vm's being imaged to two off site backup devices in two different locations and a cloud backup. My boss comes in after me talks to the guy in charge and tells him all that is needed is one server holding all storage on it just like the last server that died and one off-site backup for $4500. How stupid can someone be who has been doing this for over 20 years? Oh btw the software running on this server will be 911 dispatch, jail records and the database for fine payments. The sheriff making the final call me and my boss are meeting with him tomorrow if my boss tries to undercut me I'm going to tell them both that if the same shit happens next time they can spend the time themselves trying to recover stuff because I done the over 200 hours in just short of two weeks.11
Bad: Delete your production database
Good: Have a backup
Bad: Can't reimport it because your backup procedure uses scheme that are no longer supported for import by your cloud provider
Good: Backup are plaintext and somehow easy to parse
Bad: Spending the rest of the day writing scripts to reinsert everything.
End of the story: everything is up and running, 8hours of efforts1
Was in the middle of working on a game I had been working on for a couple months but had the original copy already corrupt so I was working on bringing it's backup up to the originals point...
Suddenly the power went down mid save, turned the computer on aaaaaaaaand it's corrupt, ended up cancelling the game because I didn't have time to rewrite and build everytbing from scratch again...
Now I don't use hard backups, all gets backed up to the cloud for easy roll back 👍2
Currently working on a web platform for a building management company for the last 6 months.
Setup web server, database and developed the whole using laravel and vue.
They are in the testing phase now, so I implemented IPSec so that they can only access it from their office.
Thing is, they don’t have a static IP, so when they had to switch over to a backup connection yesterday, I had to add their new IP in my whitelist.
Today I get and email from their manager, saying that after a discussion he had with his assistant, the web app is not in the “cloud”!!! He got that because I had to “do something” to restore access to it yesterday and because “there isn’t an icon you can double-click” on each employees’ desktop!!!
Don’t even know how to respond to that!!!5
TL;DR - (almost) childhood trauma due to Wesrern Digital crap products lead to lot of data loss and a plege to not trust or purchase their products for the rest of my life.
So, I got my first ever Wester Digital 2TB Mybook, back when 2TB was a really big thing. While in the midst of moving (not copying) a LOT of data to it, the damn disk just.. died. There was no fall, no power outage, no damage, it just stopped working. I was out of words and out of options. Tried yanking out the disk and connecting it directly to a system, but no luck because it looks like it's the HDD mobo that died.
Also stupid young me did not realise back then that, even if a "moved" the data, the original data is still most likely in their original location, and so, never bothered a recovery.
Lots of good stuff lost that day.
And as with a lot of you, my disaster recovery system kicked up 10 fold. Now I got redundant local and cloud backup copies of all critical and otherwise unattainable data.
As you may have guessed, I never bought another Wester Digital product ever again. My internal HDDs are Segate, and external is a suprisingly long lived Toshiba Canvio.6
So I am broke and can't buy a vds, I installed Termux on my android phone instead. Now I have a portable server that is capable to recieve calls and transmit sms for logs.
BUT, then I had to go to customer support due to case makes the phone get short circuited şn random times. Obviously they deleted all info and Samsung Cloud doesn't backup other users' data. (Termux emulates a terminal running on another user, which is not root by default)
Can anyone teach this teenager how to use tar properly? :D3
Just made some backup software with python to backup folders to Google Drive. I found all other backup solutions were paid or had to be uploaded to their servers, not to any free cloud storage like OneDrive. I also wanted it to be automated and run on a set schedule. I just need to make a GUI and add support for OneDrive and Dropbox!9
Catastrophic Unix failure :(
Full server rebuild ( samba, Apache, cloud) adding back all little tweaks
Thank God for daily backups (full backup restore failed to solve the problem, probably some weird pam issue)
What cloud backup service are you using now?
So far the top 3 for me:
1. pCloud - with lifetime plan
2. Google Drive
I'm thinking about buying a small nas device to store backup and media files. WD my cloud and synology ds120 caught my attention regarding price and functionality. Does anyone have experience with them? Any recommendations?8
This one time last year a colleague found out that some data went missing and suggested to recover the data from a backup. When trying to create a new database instance in the Google Cloud Platform (if everything works it's amazing!) it failed.
Not knowing why this happened, I tried to revert that backup to the production database, after creating a backup using the GCP. Needless to say that failed as well, resulting in a corrupted database instance where I couldn't access the created backups anymore.
This all went at around 10pm and the only users of our product are currently in the same timezone and use it from around 7.30AM until 6PM so no one besides our team knew the server was down.
After a long night chatting Google's support team the database was successfully recovered and the only harm done was sleep depravation for me and a colleague.
Apparently there was a bug in the GCP. It was resolved in two hours and the last time a breaking bug was in that piece was more than seventy days earlier.
I did at least learn to create local backups as well, instead of relying on the tools of the same product...
Best: the moment I saw the corrupted database spin up again and not losing my job because of it.
Rule of thumb when buying things. You need to research a lot and canvass other competitors of that product/service.
In short, I forgot to research pCloud's upload speed. They throttle my upload speed to 1Mbps only which is really slow (I'm in Asia by the way, their server is in US). Got tempted by their $350 2TB lifetime.
I tested the basic upload speed using browser 33.9MB file:
- pCloud 1 min 9 sec
- Dropbox 13 sec
- Google Drive 12 sec
- Mega.Nz 1 min 56 sec
- (I will test next sync.com)
I have a 100Mbps upload and 35 Mbps download speed. So it means "Lifetime" slow upload speed.
Side Question: Which Cloud backup service do you use and why? Thanks!2
I'm trying to move a backup User folder from a dead Windows computer over to cloud storage. In checking the size of the folder before compressing it, it shows as 1.08GB, which I guessed would be reasonable. So I zipped it and it came out to be 48GB!! Compressed to 75%! So I went one folder deeper and checked the properties of all files there. That came out to be much larger than 1.08GB. Thinking Windows has some problem revealing the true size of a parent folder and its content, I did a Google search. Sure enough, it's a bug where incorrect folder size is reported. What the heck is going on at Microsoft that this blatant of a bug would ever have a chance of getting into the code? And why is this single user at 48 GB _compressed_? I'd understand if the user was a photographer, but he's just a gamer, and these aren't applications, just save files and profile settings!
Do you guys prefer one cloud storage solution over the others? Dropbox, Google drive, mircosoft onedrive. ✨✨✨11
I have been setting up my private cloud the past weeks. And now I am thinking about backup machanisms.
I have already planned redundant storage, and I have hardware available for an additional (on-site) backup.
I am looking to create a weekly backup of several MySQL databases and a large collection of files.
Could any of you recommend a system or method and maybe describe the reasoning behind it?4
What would you guys use to backup multiple mysql databases incrementally without root access. I've been just exporting the db through PMA but I'm switching everything to a version controlled system and would like to do the same for our databases.
Oh yeah and the reason I don't have root is we have cloud hosting which doesn't provide root access. I can't even run Yum.
Any recommendations for cloud backup? I want somewhere I can backup my Linux NAS. Backblaze (personal, not B2) would be amazing if it had any support for Linux.2
I want to automatically backup all my local files to the cloud that have been copied onto my Linux server a week or longer ago. How do I do that? My idea is that if something goes wrong locally I have a week to restore from the cloud.5
Hey, can anyone give me an idea on how syncing works?
(Been searching for past few hours, didn't went past some weird advance server admins stuff or cloud backup ads.)
All i wish to do is to make a service for my app that will run every night and upload/delete /modify (basically , sync) my app's local database to the server.
Just gimme a rough idea on the algorithm to use, i have done till running the service every night( but what exactly it should do, i have no idea)3
I'm looking for an online backup service and currently having an eye on CrashPlan and Backblaze. Any suggestions?5
Can I upload purchased downloaded video tutorials in the cloud? I will not share it to anyone. Just myself. Will I get in trouble?
Example if I upload it in pCloud or Google Drive. Thanks9
I finally got around to setting up my own cloud with nextcloud on my own dedicated server.
Just setting up Nextcloud alone was not really the challenge ( I've set up at least 2 Nextcloud instances in the past ).
The actual challenge was to install /e/ OS on my mobile phone and get it to work with my Nextcloud instance.
It's not all performant, buttery-smooth or super-fast yet, but for a one-person / user-cloud, I think it should be just fine.
There's still room for improvement in terms of server-side performance, but it's working fine with the basics at least.
I need to figure / iron out some issues like social federation via ActivityPub not working, Nextcloud SMS not syncing up my SMS, Mail app crashing because I used a self-hosted Nextcloud instance, etc; but those are things I could work on slowly, in the course of time.
No, the server is not physically controlled by me, yet ( it's a dedicated box server though. Still, hosted and physically controlled by a provider ).
I intend on setting up another 'replica' on a RaspberryPi which I will then make primary, connecting to the internet via DynamicDNS.
I'll probably keep the server as a fallback / backup server just in case my home server loses connectivity.
Taking back control from Big Tech is something I intend on pursuing actively this year. I've had the idea in my head for too long that it has started to fester.
This is only a first step, of many, that needs to follow, in order for me to take control back from Big Tech.
Yes, there still is some room for improvement, but I think for now ‒