Things I've learned throughout my 5 - 6 years as a programmer.
- StackOverflow is full of assholes.
- CMS's are for weaklings.
- The best feeling about waking up in the morning is figuring out how to solve that error in your code.
- You no longer think about normal people things. Your mind is full of code.
- You're practically a computer.
- ALWAYS backup and save your stuff or you WILL regret it. Enable autosave if possible.
- RIP your social life (if your friends don't know squat about programming)
- Darkness is better.
- Being a programmer is amazing.

Had an external hdd for backing up family photos etc. (back when I just discovered Linux and still used windows as well)

Connected it to my windows system and it said that the thing was corrupt and i had to format it.

Well fuck, a few hundred gb's of pictures, memories, backups etc etc probably lost. (keep in mind I didn't know that much about computers at that point)

Was about to format that thing with literally tears in my eyes when I thought I'd, because why the fuck not since I was out of options anyways, try it as well on my Ubuntu installation.

EVERYTHING WAS STILL ON THERE AND PERFECTLY ACCESSIBLE.

After a very much rage attack on windows I formatted the windows partition and used that as a backup space as well :).

Had three servers running in prod. For extra security all of them were encrypted (hdd encryption) just in case.
"mate, servers need a quick reboot, that alright?"
Me: yeah sure!
"oh hey they're encrypted, what's the password?"
Uhm.....
😐
😓
😨
😵😨😮😧😫
😲😶😭

Yeah, i also forgot to turn on the backup process...

A friend of mine: Look at this nice app I made 😎
*shows me a normal looking app with tabs and different views"
Me: Hmmm… looks good.
Friend: Do you know how I made the navigation between views? 😏
Me: I'm afraid to ask…
Friend: Since I didn't know how to use the piece of code I found on internet, I made multiple views one above another with visibility set to false, and during the navigation I just change the visibility. 😁
Me: WTF? Man… this isn't something you should be proud of… it shouldn't be done.
Friend: Do you also want to know how I backup the code?
Me: No…
Friend: I send it to myself via email.
Me: FUCK!
Friend: I also never use while loops, I prefer to use for instead with a break inside. 😊
*blocked*

Somehow I feel like I personally owe Linus for git.

17:50 Colleague whispers "fuck" and the entire project we've worked on for the last half year responds with 404.

17:55 A quick diagnosis shows that she wrote "rm - rf ../" instead of "./" when she threw out her staging dir an thereby deleted everything.

17:58 git pull, everything is back.

18:15 everything is configured and we're up and running again.

**Alternative Timeline without Version control **

17:58 We start looking through Backup folders

18:20 We're fairly confident to have found the most up to date Backup in /var/backup/newback/v2/june/new/released/ and start copying back into the project directory.

19:30 Some files are missing we start patching shit up.

19:40 I realize how much work went down the drain and start strangling my colleague. The Api seems to do the most important things again.

20:00 My colleagues dead body is hidden and I'm 80% confident that the tasks depending on us should run.

Next day: They didn't run. Every nightly build failed, nobody can do anything useful.

A week later : Shits starting to work again, all lost files are replaced. Replacement for dead colleague still missing though.

It's moments like this that make you really appreciate the luxurys we have nowadays...

PROBLEM: A tickets' company came to us last autumn. They said they have severe performance problems and asked us to help.
SOLUTION: covid and quarantines. All events have been ceased, noone's buying any tickets any more. Performance problems are no more. FIXED.

PROBLEM: Another company came to us recently. They said they have severe performance problems with their huge databases and asked us to help.
SOLUTION: a few days of heavy rain and their datacenter was flooded. along with the backup servers. No more data, no more performance problems with large databases. FIXED

Solving problems genie style!

Who's next?

Client: Hi. my SEO guy messed up the website. Its kind of .... you know .... gone. You must have the backup. Please restore

Me (after 10 mins): Done

.............

Client: Hi again. I don't see my changes from yesterday. Why?

Me: Because I had 2 months old backup.

Client: Why?

Me: Because that's the last time I worked on your website. And you changed the credentials later on.

Client: But you're a programmer. You must have had a back door to take back ups.

........

Client: Hello?

Me: It's time to leave earth.

There's one kind of ticket I fucking love. Wait, YOU LOVE TICKETS?! No, except for one.

Tickets where people ask us to restore backups.

Why do I love them?

Because the only fucking thing I need to do is reply with a link to a helpdesk item on our website because backups aren't something within our support range because it's easy for customers to do.

So whenever a ticket about restoring a backup comes in, it's as easy as opening the ticket, pasting the link with "I'd like to refer you to the following resource: " and pressing fucking "reply"

😄

At my previous job, the person in charge of the Phabricator server didn't have a backup system in place. I yelled at him until he implemented one.

He had the server perform backups to the same drive. I yelled at him again, to no avail.

Well, after awhile the hard drive started failing, and it would only boot intermittently. After a lot of effort, he was able to salvage part of the backup data, but no more, meaning we lost a lot of bug reports and feedback, and developer tickets. We were able recover all of the older lost tickets from a previous server, so overall the loss was pretty small.

But I think he learned his lesson.
He definitely learned to listen.

Once I had to clone a repo and it was taking too long...

Went to gitlab to find out in the most wtf way that from 1mb it was 600mb+ now...

One of our new juniors pushed 600mb+ of a database backup to gitlab...

I came to her with a smile and asked in a jokingly manner (after cursing her for about half an hour in my head):

"lol, did you really not notice it took a fucking long time to upload it?"

The fucker was ashamed but just said : no, I think I pushed it and went home.

I constantly reminded her of it for the couple months...

Never done it again :)

I just hate npm dependencies.

If you want to write a small website with npm dependencies (some frontend deps like Bootstrap and some development deps like gulp or babel) you will have more npm dependencies in your project than own code. It is ridiculous, how some lazy developers just add dependencies to their projects, without evaluating their dependencies. The source code of one of my projects is around 4MB (without any dependencies). If you then run yarn as required, it grows to around 80MB (where 73MB are node_modules).

This is just terrible.

I rant about this, as I made the mistake to upload my node_modules directories when restoring a backup of my server. Worst idea one could ever have.

Although this is gonna sound like bullshit, this happened to me for real. Since that moment I use even more backup services AND I regularly check EVERYTHING.

Had a backup of my important data (still used mainstream services back then) on:

- Hotmail email attachments
- Google Drive
(Both link to another email account).
- A few data backup services
- DVD
- USB
- External HDD.

I wanted to copy some backup data over again:

1. Walk to my staple of HDD's, tried to grab it, somehow missed and knocked the whole fucking pile over. HDD broken.

2. Well fuck, let's go put some of my clothes in the washing machine for clean clothes at study/monday. After this shit being in the washing machine for just a few minutes, I realized my backup USB stick was in one of my pockets, in the washing machine. FUCK. Couldn't stop it so I waited till the end, tried it and well, it wasn't working at all anymore.
Fuck my fucking life slightly right now.

3. *remembers about the backup disc*. I forgot to keep it in its case, very deep scratches and so on, unreadable. FUCKING FUCK.

4. Right, I still have those online services! *tries to login to all of them (including hotmail/gdrive) but forgot the password. Well, let's login to my backup account then (hadn't used that one in years). Account was suspended for some reason.
Started to get really anxious because every online backup service was linked to that email address.
Contacted customer support. They really couldn't restore it because of some issues they weren't allow to tell me. Sorry but I couldn't retain access.

5. Well this is fucked up. Couldn't get into any of the backup/hotmail/gdrive accounts anymore.
I tried contacting their support but never got any replies.

This was the moment I realized I fucked up big fucking time because damn, this stuff at this level hardly happens to anyone.

FUCK.

Boss: I was looking over our expenses and was wondering why you are ordering a new piece of equipment?
Me: (I stand up & address my fellow code-drones) Can everybody save everything right now please. Good? Now newGuy commit your changes.
(Audible typing followed by the entire room groaning.)
Me: He just deleted everything...again and I am running out of backup storage.
Boss: ........So you want 1 of those things or 2?

IntelliJ IDEA just saved my ass!
I tried deleting a resource file I had staged, but not commited yet.
A dialog comes up asking to delete alternative configs with "Yes" as the default.
Boom! After I braindead hit the enter key all other files vanished too!
I checked Git and saw to my horror that the files were also not tracked anymore.
I hastly lookup the last backup timestamp - an hour ago - fuuuuu!
I just lost about an hour of work.
I was about to give up and start from scratch when I look at the edit menu in my IDE.
Turns out you can actually undo multiple file deletions!
Kudos to the girls and boys at JetBrains! You saved the day! 😙

Never in my life I was scared as today.
I recently left a big company to work for a small one as the first internal developer.
Had a small issue in the production server. The fix was easy, just remove a single table entry. And... *drum roll*... I forgot to add a where clause. All orders were lost.
No idea if we had backups or anything, I quickly called the one other IT dude in the company.
He had no clue where are the backups and how to find them.
Having some experience with Nmap, I quickly scanned our network and found a Nas device.
There was a backup, whole VHD backup. 300GB of it, the download speed is around 512kb/s. No way I can fix it before management finds out, but then an idea came to mind. Old glorious 7zip. Managed to extract only the database files, sent them to the server and quickly swapped them. Everything was fine... The manager connected 5 minutes later. Scariest 45 minutes of my life...

Site (I didn't build) got hacked, lots of data deleted, trying to find out what happened before we restore backup.

Check admin access, lots of blank login submissions from a few similar IPs. Looks like they didn't brute force it.

Check request logs, tons of requests at different admin pages. Still doesn't look like they were targeting the login page.

We're looking around asking ourselves "how did they get in?"

I notice the page with the delete commands has an include file called "adminCheck".

Inside, I find code that basically says "if you're not an admin, now you are!" Full access to everything.

I wonder if the attack was even malicious.

Had this with a relative. His laptop wasn't turning on, with or without charger so he brought it back to the store to fix it. It ran elementary os by the way (detail for later). Then he got it back after a week and we booted it and it had windows 8 installed (wtf indeed). So we called the service desk to ask about it since the issue was a broken charger (!!!). Their reply: oh yeah there was a weird system installed on it so we thought we'd reset it as well for you.

SERIOUSLY, THAT'S NOT YOUR FUCKING JOB!!

He is not tech savvy and he didn't know much about backups so that was literally about one year of work GONE. Yeah, I setup a cloud backup sync thingy for him right after that.

Built the website. He took 2 weeks to test. Then asked me for changes. I took two weeks for changes. Someday during the second week I login (wordpress), I see the old version of the site, all my changes are gone.

I ask him,

Him: I had a customer who needed to see my site... So I reverted to the old version. I had a backup.

For fuck sakes! 1st of all, if he is a customer he doesn't need to see your marketing site anymore give him a flyer idiot.

Then, for fuck sakes: Give me a fuckin call so I back up your site. Idiot.

Why you didn't fuckin back up my fuckin version.

I stopped working and passed him to a more patient, more wordpress guy.

Just idiot.

Much-security.nl is down.

No, no hack or whatsoever. I just reinstalled the wrong server through my control panel.

The new blog version will hopefully be up tonight. 'you keep promising that' - I don't have a backup of the old version and I only just started using git so I can only upload the new version (or git pull). Next to that, except for the front-end, everything works now.

😐

What I did wrong during my home office cleaning session this morning:
- put soap on my mouse mat
- snapped my enter key
- vacuumed up my F8 key
- absent-mindedly cut my ethernet cable
- lost my zero key
- dropped my backup hard drive (data was recoverable, but I need a new drive)
- lost one of the nose pads on my glasses
- got a cocktail stick stuck in a USB port
- exploded my mouse by using the wrong type of battery

Things I did good:
- nothing

A completely normal workday.

Until suddenly... the Internet was gone. Like completely gone.

Out of nowhere the head of network administration appears right beside me, yelling completely over-pitched straight into my ear "WHAT DO YOU MEAN BY ALL SERVICES ARE OFFLINE? WTF HAPPENED TO THE CONNECTION?..."

He disappeared as fast as he had arrived. With my ears still bleeding I got myself a cappuccino.

Several hours later the Internet was back. At the construction site infront of the headquarter the Internet cable was cut.

Wait. What about a second backup cable? It exists. Unfortunately both cables split only after the construction site.

You had one job anonymous engineer...

Back in my teenage , a friend of mine asked me «Can you make me a software that guesses the result of a football match ?» I said «Sure, but you have to tell me how to calculate the chances of a team»
«Yeah, use the previous performances in the league»
«Ok, but you have to tell me how to calculate the expected result using previous performances» He laughed at me and said «If i knew how to calculate chances of winning/losing, i would not need a software!»
I tried to explain it simply «Computers can execute basic operations like sums or subtractions, and they know how to follow a list of basic instructions to give you a result»
He looked me like «If computers are so stupid like you are telling me now, are we all crazy idiots trying to learn how to use stupid machines??» and stated that i obviously misunderstood the real power of a computer. I walked back home thinking how funny was my friend believing in some kind of magic inside box called pc.

Few years later, i start studying IT at university. In the free time i look for small jobs like website development, small office network setup, pcs repair.
I continue noticing people believing that pcs knows what to do and how to do it.
«You sure I lost my data ? No i didn't do a backup. You sure my pc didn't do a backup ? No i hadn't a backup software»
«Why antivirus asks me what to do with the viruses it found. It should delete them obviously! Change my antivirus, it's too stupid for my pc»
«I want more people finding my business thanks to my website. How I imagine my website ? Yeah it has to be cool and full of cool stuff»

All that boring stories leads to my final question :

is our job dealing with persons who think we are some kind of wizard, well learned about dominating the pc magic ?

Please answer no.Please.

You can hate me: as a 34 year old php developer, i've never used git in my workflow...
I plan to start today using it on one of my personal project (only because i have arrived at "backup-49.rar")(yes i develop on windows).
Finger crossed

My mom got cancer and passed away two years later. I had made several videos to document her life. All of that, plus photos and video of our family, lived on a backup drive that got dropped on the floor a few months after she passed away. Head crash that wasn’t discovered until it was turned on again and forever destroyed the platter. It was the largest set of photos and video I had of her. All forever gone.

Friend: I don’t need git. Git is for people like you who cant do good backup of their code
Me: Yeah, yeah, go do whatever you like...

2h later comes to me:

Friend: Can you make me repo and show how to use it...?
Me: What..? You drunk?
Friend: Naaah, no... My disk broke while ago...

Karma is a bitch :D

A recent project actually taught me how HORRIBLY STUPID it is to store large bodies of text in a SQL Server database. There were millions of records with pages of compressed text each.

More and more text records pile on every single day. Needless to say it was becoming super slow and backups were taking WAY too long.

After refactoring them out as compressed files to disk storage (I love you, micro-services) and dropping them completely from the database, the backup size went from 90gb to 3gb!

It's not every day you get to see a dramatic result like that from a refactor.

Lesson learned, and yes it was quite cool.

At my old job, me and a colleague were tasked with designing a new backup system. It had integrations for database systems, remote file storage and other goodies.
Once we were done, we ran our tests, and sure enough. The files and folder from A were in fact present at B and properly encrypted. So we deployed it.
The next day, after the backup routine had run over night, I got to work and noone was able to log in. They were all puzzled.
I accessed a root account to find the issue. Apparantly, we had made a mistake!
All files on A were present at B... But they were no longer present at A.
We had issued 'move' instead of 'copy' on all the backups. So all of peoples files and even the shared drives have had everything moved to remote storage :D
We spent 4 hours getting everything back in place, starting with the files of the people who were in the office that day.
Boss took it pretty well at least, but not my proudest moment.

*Stay tuned for the story of how I accidentally leaked our Amazon Web Services API key on stack overflow*

/facepalm

Today I announced to a customer (a shitty one) that we had lost all their data. When I was done explaining what happened, one of my employee turn to me and said :"oh! I know where the data are. I did a backup there". It was after 1 weeks of searching that the tech decided to tell us he knew where all the backup went... Now I have to call the customer again...

This happend to me around 2 weeks ago. For some reason, I decied to post this now.

I won the lottery, yey! I mean, bot really, but I am <19yo student, "less than junior dev" in my office, but sonce I am the only one who is capable of working with hardware, I was working month back as a sysadmin for a few days. Our last sysadmin was really good working but really, really toxic guy, so he got fired on a spot after argument with some manager or whatever, no big deal, we could have another guy hired in a week. But, our backup server literally was on fire, all data probably dead because bad capacitor or whatever. This was our only backup of everything at the time. Everyone in full fucking panic mode, we had literally no other working HW we could use for backup, but then comes me, intern employed on his first dev job for 3 months. That day I bought some HW for my own personal server at home (Intel NUC with some Celeron, 4GB DDR4 RAM and two 240GB SSDs for RAID 1. My manager asked everyone in the office for sollution how to survive next 4 days before new server arrives. People there had no idea what tk do and no knowedgle about HW, I just came from a break and offered my components for a week, since there was noone else who can work with HW, servers and stuff like this, manager offered me $500+HW cost if I, random intern, can make it work. I installed Debian on that little PC, created RAID1 from both SSDs, installed MySQL server and mirrored GIT server from our last standing server (we had two before one of them went lit 🔥), made simple Python script to copy all data on that RAID, with some help of our database guy copied whole DB from production to this little computer and edited some PHP so every SQL request made on our server will run on that NUC too. Everything after ±2 hours worked perfectly. Untill a fucking PSU burned in our server and took RAID controller with him in sillicon heaven next night, so we could not access any data unltill we got a new one. Thanks to every god out there, I was able to create software RAID from survived HDDs on our production server and copy all data from that NUC on the servers software RAID and make it working at 3 AM in the night before an exam 😂. Without this, we would be next ±40 hours without aerver running and we might loose soke of our data and customers. So my little skill with Linux, Python, MySQL and most importantly my NUC hardware I got that day running as a backup server saved maybe whole company 😂.
Btw, guess who is now employee of the year with $2500 bonus? 😀
Sorry for bragging and log post, but I was so lucky an so happy when everything worked out, good luck to all sysadmins out there! 👍

TL:DR: Random intern saved company and made some money 😂

Around 27 hours at new customer location.

They had a server failure due to incompetence.

They had fired their own IT guy and called us 6 months later because the server stopped responding.

First diagnostic. 2 drives are dead in a raid 5 with one hot spare. Raid controller then proved to be broken once the disks was replaced.

Waiting for new raid controller and installing.

Backup non existing, no one changed dat tape during the 6 months without IT. The tape was just a transparent plastic band, no media left.

Raid config is stored in static ram on controller, no backup!

Several hours in tech support to find out how to rebuild raid config from existing disks.

Proves to be impossible to rebuild raid set due to some checksum failures.

More hours with support to enable some diagnostic read only mode to mirror low level content to external drive.

Then many more hours to copy parts of the tree until it gets an error, restart after that and go on.

In the end we got around 70% back.

During this time I manage to be in contact with the raid manufacturers all support centers, one in europe, one in the us and one in Taiwan, switching each time one if them closed for the night.

The customer later declined a steady support contract due to us being to expensive ;)

Some just don’t want to learn.

Downloaded a Hello World template for a HTML/hybrid mobile app... My node_modules folder has a backup of The Internet now...

Let me just delete this symbolic link and leave it copying the folder to the ssd real quick while I go to lunch...

Lessons learned:

1 - don't put a fucking / at the end of `rm -rf /path/to/link`

2 - don't ignore the warning of it being a folder after trying to `rm /path/to/link`

3 - backup your fucking dev database too

4 - don't do stuff hungry

SHIT!! FUCK!!

Well, just remembered a fuck up one of my friends and me did. Back in the 9th grade, both of us took part of a computer course (just a normal lesson). He got me into programming. So after half a year we "hacked" into the school server. Tbh it was quite simple. The server did a backup each week in a specific folder. The problem was, the backup file had no proper rights set. Everyone had access to it. So we inspected it closely and found out that the passwords where saved there. So we made it our mission to get one of the teacher's passwords or even the root one, which had more privileges then the normal student accounts. After about 2 days we managed to crack one of them (using a hash table available for download). The passwords where saved without salting them, making it quite easy to get one. Now we were sitting there, having access to a teacher's account. So we logged in and tried to figure out what to do next. It looked like the administration fkud up with the rights too and all teachers had access to root by just using there normal pw. Well, the Grand final is coming. We put a script into the startup of the server (which restarted at 4:30 AM each Friday). The only line that was written in it was "./$0|./$0&"

We never got caught. And it was a heck of fun ^^

Yesterday, after six months of work, a small side project ran to completion, a search engine written in django.

It's a thing of beauty, which took many trials, including discovering utf8 in mysql isn't the full utf8 spec, dealing with files that have wrong date metadata, or even none at all, a new it backup policy that stores backups along side real data.

Nevertheless, it is a pretty complete product. Beaming with pride I began to get myself a drink, and collapsed onto the floor, this caused me to accidentally hibernate my computer, which interrupted the network connection, which in turn caused an OSError exception in one of my threads, which caused a critical part of code not to run, which left a thread suspended, doing nothing.

From the floor I looked at my error and realised my hubris and meditated on my assumptions that in theory nothing should interrupt a specific block of code, but in reality something might, like someone falling over...

Came back from vacation today to find out that some FUCKTURD PIECE OF SHIT deleted my virtual server!! Tried to find any traces on who that SHITFACED NUTSACK was without luck. This server is hosting several websites, some having files and data stretching over more than 10 years! Spent the day praying to GOD that my equally old backup scripts had run and where the FLYING FUCK those files were saved. Luckily the script had worked and I found a recent backup so now I can start the restore process on another machine. But still. WTF!!??

Big project this week. Lots of fires to put out. Deadlines approaching.

Monday: I can get by on just four hours sleep. No problem. Will be just like college.

Wednesday: I'm going to just close my eyes while this file uploads. Maybe I will backup the server while I'm at it; Just take a nap while that processes.

Friday: Sorry if my office smells like vomit. It's because I am so tired I vomited.

Sunday: I'm not getting out of this bed tomorrow. Let them fire me. I think I will just will myself into a coma. That will be nice.

I can't figure out what's worst in the new system we got handed over from a client:
1. that they have an every-minute-cron-job with "sudo chmod -R /var 777"
2. that the backup of their database haven't worked since 2014 because the S3 bucket is full
3. It's written in PHP, by one guy, who didn't knew PHP when he started work on it. (All MYSQL calls are String-concats, etc)

Linux gives you so much freedom, for example the freedom to fuck your system.
When i was experimenting with bootsticks i typed the following in the terminal:
sudo dd if=bootstick.iso of=/dev/sdb

Where is the mistake? The usb-stick was already plugged in at boot-time and since it was bootable linux mint named it /dev/sda.

You propably already realized it, i wrote the iso the my harddrive. My attempts to restore the partition-table failed, but luckily the kernel still had it in memory and i was able to backup my files via nautilus.
Still, i nearly had a heart attack

THE WORST PRANK ATTEMPT

If i remember true, it was 2012. april fool day..

me and my co-worker (we were the founders) decided to fool our members (we had a script's unofficial support forum). so, we did the plan. we register another account on march and wrote a few useful messages with it. help guys with that fake account (named as Root).

on fool day, we move the site to hidden folder (but didnt backup it) and added an index file as "hi, i am Root. you know me who am i. i hacked this site and deleted all dbs. cya later" (in turkish of course)

and we sit our chairs, began the watch our messages from facebook,skype,whatsapp etc..

we act like we are in trouble and we cant solve the problem.
at the same time, one of the our crew, decided to help us :D
so, he contact with our server's management crew. they dont know the fool too :)

server management looked up the situation without try to contact with me or my co. and we got an email from server like that
"hello tilkibey and impack, we just realized your site is hacked. so we delete your all ftp and db for safety. please contact with us asap"

we shocked and contact with them, explain the truths and request the recover our site (because we though they backup site before deleting all things). but they didnt backup it :(

so, we recover our last backup which is got nearly 10 days ago :(

I guess this is the reason why companies are not transparent. The way everyone is ranting on GitLab and saying this is the end of them, many of us won't even notice if GitLab wasn't this transparent and directly said they removed prod db.

This kind of things happen. Even in companies. They have a very bad backup system and they should learn from it.

I hope they recover and keep up their good work.

Who else agrees that the play store should have a section which tells if an app needs a mandatory login to use it ? Like why the hell does a simple offline planner todo app need you to sign-up if you don't wanna use cloud backup. Jeez the user just trusted you by spending valuable time and bandwidth downloading your app. You owe it to him to show him some features of the app before shoving a sign up in his face. As an app developer myself I really think that this kind of behaviour turns off more users than anything else.

Hello devRant, a question for you.

I'm looking to redisign/setup my server 'infrastructure'.

It'll exist out of:
7 vps's (6+gb ram/500gb+/100mbs up/down per vps)
2 dedicated servers running as virtualization servers. (16gb/4tb/1gbit up/down and another one but let's leave that one out for now because it's gonna take a shit ton of time to solve that clusterfuck)

One server will function as an entry point for all websites I run, multiple database servers and multiple backup ones.

Any advices/tips/ideas?

Just a very serious hobby thing :)

I keep a backup of most installers because I have a poor internet connection.
Imagine my disappointment when one of them is just a downloader for the full installer.

When the last battery of one of your phones die. And you don't want waste more money with a new one.
But you need to perform a backup.

Aaaaand my whole world came crumbling down. All I have is a laptop with a battery backup of 15mins, and now the charger broke.

I was almost done with coding a nice feature, just few more lines and I would have been able to push.

But, rather it went dark. And now I can't code, nothing matters, everything is meaningless 😞

Customer has thousands of clients - puts each client site under a subdomain of the main domain on a shared server. What happens to every single website when the server runs out of space?
But that'll never happen, right? We have lots of space. It certainly won't happen on day one of the main tech dev's holiday.
...twice...
It's fine, there's a backup, or atleast a redirect, right
.....right?

Sister of a friend of mine fucked up her Mac, her Dad, they called me to fix it.

Partition table is wrecked and her thesis is there, no backup.

Been working since yesterday, got to recover it. Recovered files.

Dad applies pressure, because she's leaving out of town today, I do my best but fucking SSD won't work, it says it's healthy but damn Mac says IO error, Disk Utility says exit code 8... oh, and her dad thinks it's easy, that Ive been delaying things and so on...

fuuuuuucking hell, I hate you

My manager is a "you don't know shit" kinda dude.
This one time while guiding us on how to operate on databases which existed and somehow, he deleted the whole database.

Ofcourse, to save his ass at once he claimed "This is why I was telling you all this, see!? The whole database got deleted"

And yes, we had a backup of that database. And yes we weren't able to control our laughter too.
You should have seen his face.

Whenever something goes mainstream and becomes buzzword there are annoying consequences of it.

First, it’s harder to find anything meaningful about the topic.
Second, suddenly everyone is an expert and web search starts to show not related products like promo codes, stupid videos, tutorials for dumb.
Third, old content that was interesting is lost under pile of shit or gets deleted.

I feel like I’m living in middle ages and before I try to watch something interesting it’s deleted by Spanish inquisition and replaced by some crap.

Most of expert content I have in favorites is returning 404 and youtube videos are deleted or private so from some time I started to backup all content I read or watch and find interesting in public networks.

Fortunately I have couple of terabytes of storage to backup interesting topics but I’m not happy that I’m back to times when I was saving internet page to floppy disk to show it to my friend later.

What a fucking nightmare.

It is a sincere request to all the people who are asking for a backup of their files and documents, to please stop pestering us regarding the same.

We can't possibly collect your data, and even if there's a way, it would be nearly impossible for us to find your data from billions and billions of files and directories.

Citizens are requested to please understand our problems.
Have a nice day :)

Forgot to push 30hr of code before moving to a new ssd without backup...

Last week I was erasing a 2Gb USB thumb while copying some really important shit to my backup disk. I look at the terminal and see it's taking a lot of time to did zeroes on dev/sdb.
Then I realized that dev/sdb is the backups drive and I just erased the firsts sectors of my only fucking backup.
It's ok, I said, let's see what can TestDisk do for me. And it only could find an empty sad partition that had useless shit on it. Whdd couldn't even find the drive. Cat and dd vomited 160Gb of nothing to a file that couldn't be read. I was lost, because I failed doing something I'm really good at. And I did it because I was to stupid to check fstab...
It's the very first time I couldn't recover data, so I'm thinking about delete "Data recovery" from my resume skills and put "Data cleaning. Really effective. I can send you 160Gb of pure horse shit to prove it" instead.

the team gave access to the database to another team, and one of their guys did a delete cascade by mistake thinking it was theirs... everyone was scrambling for days trying to get a backup, thankfully there was one

And this, ladies and gentlemen, is why you need properly tested backups!

TL;DR: user blocked on old gitlab instance cascade deleted all projects the user was set as owner.

So, at my customer, collegue "j" reviews gitlab users and groups, notices an user who left the organisation
"j" : ill block this user
> "j" blocks user
> minutes pass away, working, minding our own business
> a wild team devops leader "k" appears
k: where are all the git projects?
> waitwut?.jpg
> k: yeah all git projects where user was owner of, are deleted
> j.feeling.despair() ; me.feeling.despair();
> checks logs on server, notices it cascade deletes all projects to that user
> lmgt log line
> is a bugreport reported 3(!) years ago
> gitlab hasnt been updated since 3 years
> gitlab system owner is not present, backup contact doesnt know shit about it
> i investigate further, no daily backup cron tasks, no backup has been made whatsoever.
> only 'backups' are on file system level, trying to restore those
> gitlab requires restore of postgres db
> backup does not contain postgres since the backup product does not support that (wtf???)
> fubar.scene
> filesystem restore finished...
> backup product did not back up all files from git tree, like none of refs were stored since the product cannot handle such filenames .. Git repo's completely broken

Fuck my life

Just watched Snowden

to check if Edward had completed his assignment that is supposed to take 5 hours but Ed does it in 40 min, top CIA director guy types:

cd backup
ls

Into computer terminal.

Pats Ed on back. Well done super hacker.

Apparently by opening a folder and looking at what files are in said folder you can confirm the success of a CIA exam.

A few years ago I found a public AWS S3 bucket owned by a fortune 500 company containing a database dump backup with all of their users unsalted md5 hashed passwords.

I didn't report it because I don't want to get sued or charged. I don't know whether it's still public or not.

I took this contract and made the suggestion that we backup to the cloud and create a private repo on GIT. Client said no, local should be fine, they don't want someone stealing their code. I said okay fine.
AC just went out in the server room and they apparently had a leak from the AC to the power supply which they happened to put on top of the rack servers and switches. I'm surprised that place didn't catch fire, might be to early to call it.
All this on a Friday and we were 2 weeks away from launch party.
Not my fault, I clearly said we backup to cloud and use GIT on private repo.

The moment when you realize, that you have a more careful backup for your dotfiles than for the pictures of your newborn son

Someone had the bright idea of going 100% on premise then only having the VPN on the server in the office building with no backup to another server. Well the power went out and no no one can work or work remotely. What a plan.

The website of the italian post service is "closed" between 23:45 and 00:15, everyday.
I don't know if something like this happens in other countries...

And do you know when I really need to access it?
ALWAYS IN THESE 30 MINUTES, not the others 1.410 of the day!

P.S.
What do you think, what could be a valid reason to "close" a web service?
I thought about backup, but other services don't have this problem.

Completely got my localhost and live database confused and dropped the whole live server. And there was a power outage so the last backup is from Friday. Luckily not completely live, but still having a stream of people walking in. Also pretty obvious that they are talking about me especially since there's no other shes in the department.

One of my hard drives S.M.A.R.T. said it could fail anytime and I should backup my data. I cut all the files to a new hard drive.

Later that week the new drive fails with the needle falling into the magnetic disks... Fml. 

Should've saved those files on the cloud...

Two things before this all:
- I fucking love gitlab so far
- I miss the fuzzy searching from sublime text, as vsCode still can't do it properly..

I was fed up with all the shitty overbloated git deployment scripts, sync scripts, automatic backup solutions and hosted git servers out there, so now my own solution is:

- remote git cloned local files
- local files are synced via dropbox, to easily edit them on any device
- all changes and deleted files are saved up to 1 year on dropbox
- remote has gitlab running and webhooks setup
- the webhooks point to my node scripts, which then rebase the code to its dedicated dev server
- daily server backup with 7 days roll
- cold storage backup each 30 days

Sounds like overkill, but from my experience, you really can't have enough places that have a backup, especially coldstorage backups.

My goal in general though is to have everything on my computer backupped and ready to go asap, if something happens.

I wanted to just use a virtual machine for development stuff, but that wouldnt be able to run on my laptop, so I need a more general solution, where I sync all configs and all projects across. (and have some sort of basic list of tools needed, so I dont need to remember them)

Found for example something for vscode to sync its settings and plugins via any sort of git, will give it a try in near future too.

First week in the job and I was told to update an intranet page. Opened it in notepad, made the change and saved it.

Turned out it was a SharePoint site and saving it in notepad broke all the links and turned it into a static page. Even worse, it was the homepage of the intranet.

I blame lack of training and, in hindsight, how awful SharePoint is.

Anyway, at least we successfully tested the backup process...

My friend dropped her phone and it doesn't turn on anymore, but she has a dual-SIM spare phone. So the problem didn't seem too bad at first. I told her I'd help her with the backup restoration, set everything up on her new (old) phone.
After 30mins of trying to restore the backup from her old phone and moving the SIM card to the new phone...

"But I didn't have a backup and the SIM card tray isn't working. Can you also help me recover my 10 000 pictures and songs?"

I guess I'm done here

when I was a newbie I was given a task to upload a site.
I had done that many times before so I thought it wont be a big deal so I thought I never gave a try uploading through ftp.
Okay I began work on it the server was of godaddy and credentials I got were of delegate access.
right I tried connecting through ftp but it wasn't working thought there's some problem with user settings why shouldn't I create my own user to stay away from mess.
Now I creater my own user and could easily login but there were no files in it saw that by creating user my folder is different and I dont have access to server files I wanted to take backup before I do upload.
now I was thinking to give my user access to all files so I changed the access directory to "/" checked ftp again there was still no file.
don't know what happened to me I thought ahh its waste of time for creating ftp user it does nothing and I deleted my ftp account.
now I went through web browser to download data and earth skids beneath my foots. Holy fuck I lost all the data, all were deleted with that account it scared the shit out of me.
There were two sites running which were now gone.
Tried every bit to bring them back but couldn't do so. i contact support of godaddy they said you haven't enabled auto backup so you can't have them for free however they can provide their service in $150. Which is 15k in my country.
I decided to tell my boss about what happened and he got us away :p I wasn't fired gladly

Client wanted a site for the 100th anniversary of an important local musician. They wanted to show calendar of events, biography, store, and more. We started the work 8 months before the commemorative date, and after 4 months, the site was 99% complete and waiting final review and approvement. 2 weeks of silence has passed, when I got an email saying their deleted the site from server and all backups, and now they wanted all the work back.

With luck, I could restore a partial backup, and the client didn't want to pay for redo the rest of the work.

10 months later (yes, after all the events has started and the site being off) they contact me again, asking to continue the work.

I was happy to say no.

Me: deployment exploded, the database has to be restored.
C: yeah, the latest backup we have is is from Q1 2016
Me: wat? We have almost weekly changes of the database layout, let alone the content.
C: yeah, you have to execute somewhat 60 sql files ... Have fun
* Sitting in a corner and staring apathecally at the wall*

Not goals. More like dream...

... To get into that one uni that I actually want for phd.

I have gotten so spoiled playing with robots and neural networks, that I can't even imagine falling that badly from grace to go back to... web development. Like I'm not looking down on it, it's just that I found my passion and there is not enough jobs available out there for me without going through phd or high-end research.

... And I honestly don't have a backup plan. There are choices, but I don't like any of them. So here goes hoping they accept me. ¯\_(ツ)_/¯

About 3 years ago, my girlfriend had this laptop that she got from her University. She had to give the laptop back to get reset, but didn't want to lose all of her data on it, and a backup would be around 750GB.

So I suggested that I would backup the laptop (was thinking to just dd an image and go from there). So I plugged in my mobile USB and external hard drive, and started the imaging process. Given the amount of data and setup, the process should have taken about 5hours. So we left it there for 5h.

Please be mindful that at this stage in my life I knew very little about boot processes, oses, and hardware.

5h after. The laptop screen is black and it ain't responsive. Not sure what happened, the dd process was completed, but the laptop refused to boot into windows. Tried a number of boot tools, and spent a crazy night hacking at the machine. But the university had some of sort of fail safe to not allow anyone to boot into windows if someone opened bios without entering a password. Whatever this was, I spent over 12h trying to either open mount the windows partition with a Ubuntu usb or mount the corrupt dd image on my laptop.

Long story short, after throwing at it a number of fixes. I was able to mount the image, copy out all of her personal data, and reinstall a new version of Windows on her laptop. The university didnt understand why the laptop was already reset. She still mentions this to me anytime I want to take a "custom approach" to software lol

Why you should always backup.

Nearly a year ago I developed a whole project (iOS, tvOS, watchOS), but I never backed it up because I had a recent machine and thought the chance that something happens to the disk is so small I didn’t backup. But then my mac didn’t start correctly. So I needed to reset it. Lose the project, some other files but not much else. Then I recoded the project and backed it up on multiple places. But a little later, I was writing another app, again didn’t copy again... This time I deleted the wrong folder and deleted the trash, was gone too. So from then I learned to copy everything I coded. All projects I work on, I keep a copy of on an external disk, GitHub and Bitbucket. Assuming they wont crash all at the same time 😉.

So I recommend everyone to backup all your code. Even if it’s only 500 lines. Losing it is hard...

!rant
For the second time in a row, one of our customers decided not to pay their server. The server, on which a lot of the work we did for them (online shop) was hosted. Shortly after completion, we specifically told them to backup their stuff on a daily basis, secure their server and regularly update it... Guess who did neither of those things, in addition to not paying their server after more than 5 reminders, and still complains about their shop being offline. Fucking idiots.

How I feel when I have to restore bits and pieces of a live database from an old backup

*installing linux on my mini laptop*
- Dad: "you should make a backup image of windows 10"
- Me: "LOL NOPE!"

(With 2gb of ram, linux makes it the perfect lightweight coding machine. But with W10? Jesus christ)

I haven't posted here in ages, but I thought I would come on and gush to perhaps the only community that might have people in it who would care: Insomnia allows syncing with git repos to backup your collections! For me, that means that I now have a bunch of repos in my forgejo instance for insomnia collections.

Even if I was a subscriber, I would still much rather sync between desktops this way.

Anyway, I hope everybody's doing well.

Running a wild UPDATE statement against an inventory database, it was chaotic and didn't have backups.... yea I know 😅 the backup service died god knows when and no one noticed. I was only new at the time so #notMyFault

UPDATE stock_on_hand = 0; WHERE id IN(1,2,3,4,5,88,972,7388);
# rows affected 1,234,567,890

> I think I almost died inside.

Oh the fun that mess was to clean up.
The positive outcome of this was, we had backups working again not long after and the inventory counts where accurate after that stock take.

Once upon a time, an IT major named adamyeti thought it was a good idea to work on projects directly off of a flash drive with no backup. Halfway through a large ASP.NET project, the drive failed. I fumbled through a free drive recovery tool, but all of the data was scrambled and corrupted.

I ended up having to start from scratch on the project, but I learned my lesson for sure.

Tfw you accidentally chmod'ed the entire root of your cloud server, because you've misplaced a "/".. Thank god, that there is such a thing called a 'backup'.

The amount of sweat and stress I had when the SSH disconnected and I couldn't log back in, the Apache and MySQL services that began to throw failures..

It's on moments like this, that you really appreciate the 24/7 customer-support! 😂

And all this while I was at my job, working for another company..

I goofed up and forgot the WHERE clause in my UPDATE query. Accidentally all of production possibly updated because we don't do test databases. I think it didn't actually go through because I cancelled it but now I need to restore a backup and compare data. Which means explaining this to the co-owner who can help me with a restore. I'm mortified, more so because it was a stupid thing to do to begin with.

Just a reminder, services like Google Photos are not a backup.

Want to lose nearly three years of photos?
Use Google Photos and do not keep offline back ups of your photos / Takeout archives.

Everytime I read "USB", My mind consider it a backup of USA.

🤷

"we have add a lot of cost partly due to currency exchange rate, but we also added some services and servers, we'll have a meeting and see what we can cancel or re-arrange."

So now....
- JIRA is gone
- SEO tools are gone
- budget for site security & SSL undecided
- Servers are too expensive.
$800 for twelve 2-24gb ram servers with backup, I call that bargain

Can't wait to see the websites falling apart. Now where are my popcorns?

So recently I wanted to make a backup of my phone and something unexpected showed up :o

I have a new boss who was hired today. Well, I guess he's supposed to be a 2nd in command to my current supervisor, but I still have to report to him too I guess.

This dude is a high-sodium seasoned dev, and the kind who thinks anyone who's been in the industry less than 15 years should be at best a test engineer or thrown into the 7th ring of Customer Support.

Ugh. I'm now out of gin, which was my backup to my scotch. And this prick expects me to have a PR ready for him to review on a whole new application I've been working on for the last 2 weeks by midday tomorrow. And today was his first day.

*Me trying to restore a backup*
Me: Where's the damm fokder?
My grandmother: It said there was some kind of mistake in this folder, so I deleted it
Me: *screams internally*

When you get 'last weeks backup' but the files have a date of NOVEMBER....

Yesterday I had to start the windows 10 partition on my work laptop in order to use a shitty conference call software that works only on Windows. Windows decided that it was time to upgrade the system without asking me, so it deleted grub from the MBR, and destroyed my Linux partition (I had to recover it from a backup sector and it was full of errors).
Result: I wasted my morning fixing the laptop.
Thank you Microsoft.

Testing an attendace machine API one by one so i know what does what.

And there’s an API for wiping all the attendance data stored in the machine.

I didn’t realize it until i push the damn button.

The attendance machine just become fresh like new 😱😨😰

Shit.

A testing session just become an extreme sport.

Thankfully the IT guy has a backup but just up to last month.

Well, it’s better than nothing isn’t it?

He just tell his boss that the machine was run out of memory and the attendance data for the current month were not saved.

And he ask him to buy me some machine for testing.

Yes, i was living on the edge by testing in the production machine.

I really felt like a badass one time when I managed to recover all projects on our dev server after a full meltdown of the HDD.

We had no recent backups, because our backup server was down for a few months, and our (at the time small) company was in a tight spot on finances, and couldn't get a replacement.

The problem was that the HDD on the backup server failed, but we were storing all projects also on the dev server, along with our local git repos (no GitHub at the time for us), but then the dev server HDD also broke, and I used every piece of data recovery software I found trying to recover the data, until one actually managed to read the raw data from the HDD and store it as a virtual drive, that I then used to try and build another partition index and it actually worked!

Lost about 10% of the data, but that was enough, as i managed to recover all the git repos and databases...

I don't even remember the tools that got the job done in the end, but that was one hell of a week, and at the end I felt like a true IT God!

True story!

PS: 2 weeks later we had a new backup server, another offsite backup solution and a GitHub account for the company. Was delayed on salary in order to manage it (me and the CEO both agreed to give our pay for one month to get them), but worth it!

Now that github is also offering unlimited private repos to free users, I'm thinking of using it as a backup of my gitlab private repos.

Like pushing to a gitlab private repo auto push to a github private repo kind of workflow.

I will search how to do it online.
However it would be awesome if anyone with similar previous experience can share their wisdom here 😁

Team: * hands over release to QA
QA: Release broken. It doesn't load any entries from the test system.
Me: Not possible. It works perfectly fine in our environment and we haven't touched that logic in weeks.

A couple of days later...
QA: It seems that we accidentally deleted all the entries from our environment. We'll apply a backup.

Team, clients, air wasted to keep these people alive:

Who doesn't already deleted a DB from production server because tought that is deleting it from localhost's Phpmyadmin? Yeah, shit happens...
.
.
.
It seems less shitty when you have a backup of it from last 9mins, but sucks as well...

1. Always have a backup
2. Don't be afraid to fail

Failing is one of the best ways to get better at our craft. Fear is a healthy response to a challenge, but don't let it control you. Go for it. Things will break and that's okay because you have a backup or a way to undo the change. Learn from the mistake and perfect your craft.

I was cleaning up my hard drive and deleted some old directories.
I was notified that my backup just started and wanted to look how far along it was.
However, instead of 'ls -l /mnt/DATA/Backup' my shitpile of muscle memory typed 'rm -rf /mnt/DATA/Backup'... That's when my harddrive suddenly had 750GB of free space and I decided that I probably need some sleep.

Before any of y'all wanna lecture me on off-site backups, funny thing: Today I implemented a new daily backup routine (praised be borg) and therefore deleted my somewhat chaotic Backups on my NAS "Because if shit hits the fan, I still have my local Backup"

So my coworker is gonna change computer and for the past two weeks is "annoying" me to install Ubuntu for her...

Look ... I'm a dev just like you... Get your shit together and do it yourself or wait.

So Wednesday I gave her the task to backup her shit because I'm gonna do it today... Guess what she told me? That I'm better at it and if I could do do for her...

Sure.. Yeah... Gonna rsync your /home/user folder to the new machine and fuck you if you loose anything, that's not my fucking job you useless piece of shit.

Brace yourselves for the sticker board of my retired ThiccPad T540p with which I spent my undergraduate college years! My new laptop has no sticker on it ( maturing perhaps?) but has MOE POWA BABEY...
Keeping it as a backup device and an antique.

Quick Tutorial: How to find a missing bug.

0) Wake up & have breakfast
1) Goto work
2) Do your job until the end of the working day
3) Make a backup
4) Shutdown your PC
5) Stand up
6) Go to the office door
7) Grab the door
8) Now the phone rings
9) Turn and go back
10) Take the phone
11) Now you get the bug report

This is a well approved method.
It always works!

Ah, my brain, MY FUCKING BRAIN!

Got some work from the previous company. Need to update some stuff on their website.

Fine, got the files from the server via sFTP.

Made the changes, before uploading the files, wanted to create the latest backup.

Downloaded the files again, just to realize that I forgot to cd into a different directory before re-downloading the files. All the changes are now overwritten.

Half an hour of work lost. DAMN IT!

IT admin on paternity leave since Friday.

Can't access one of our servers, backup person can't find their password.

So... Looks like I'm doing something else for a bit.

It's sometimes really anxiety inducing thinking that all data could be gone, if somebody decides to kill/discontinue/crash [see gitlab shitting 6 hours of data due to fucked backup strategy and shitty seperation of servers] your account/service, be it server, git-repos, backups, chrome syncs, games, music, sim card, ..

But there's simply no way of having a backup of absolutely everything (ignore DRM) - especially automated and abstracted away from you, so you don't have to do all that shit yourself

Today we learned:

Don't run a backup integrity check on terabytes of data in multiple jobs your cpu can't handle.

And i cannot abort the process...

Guess i have to go outside, in the cold, brrrr.

I literally only wrote one line of code today. Don't ever start your day off by saying, "I think I'll make a quick backup of my primary hard drive."

At one point, my laptop's hard drive went down. Turns out, windows had written some garbage data to the mft, and fucked up the file structure. Luckily i was able to restore a big chunk of the data using recuva. I cleaned the disk after saving the most important files, cleaned the disk, reinstalled windows. All good so far. I put the laptop's drive and my recovery disk into my desktop to put back the files. During the install in forced me to make an account, which I wanted to delete. So I ran "rmdir /users /s" and went to grab a cup of coffee. Turns out, cmd was pointed at my recovery disk instead of my laptop disk. My whole backup wiped.

Today at work I accidentally redeployed our ELK instance without taking a backup of all of Kibana's saved objects...

I didn't realize Elastic stores all indexes including the Kibana's in it's app folder by default.

Tomorrow will be fun.... I can't decide what to do first... Recreating all the charts and tables from memory... Or fixing the deployment script to change the data dir path...

My .pryrc and a Ruby script it loaded (in another directory) both disappeared seemingly without cause. I lost days of work including a bunch of debugging and performance utilities I wrote over the past year.

But I have no clue how this happened. Neither the .pryrc file nor the script’s folder are tracked by git, so it wouldn’t have been deleted, overwritten, stashed and dropped, etc. None of the other dot files are missing, and the folder is still present, albeit with one fewer files. I wouldn’t delete them, and commands that would delete them do not appear in my zsh history. So I’m at a loss. Figuratively and literally.

They’re just. Gone.

Is there any way to recover missing files on OSX?

I never thought I’d need a backup solution for local scripts.

Sometimes In wonder if the support at my hosting company are a team of highly untrained monkeys.

I know jack shit about the finer details of server management, thats what I pay you guys for.

But you guys could at least try to be a bit more usefull.

If I ask you guys about the backup functions you could try to answer my questions instead of telling me what I can see on my screen myself. Because I can read pretty damm well.

After 3 days of getting no answers and not being able to backup to server with the tools you build and are telling us to use. The server died and now you are telling you can't recover the data?

How about fuck you! So we got no backup because of your fault you now tell us all our data is lost?

We got our own backups but rebuilding the entire server and infrastructure is going to take days.

Going to be a fun couple of days telling clients why shit isn't working.

!rant

I've always been kinda lazy about backups and such, thinking it wouldn't be so bad, and "I have my most important stuff on Dropbox".

Just now, for some reason one of my hard drives just stopped for a bit, and I couldn't do anything with it anymore. Luckily it went away after restarting my pc, but it scared the shit out of me, as I almost lost 500 gigs worth of music, films, documents, etc...

This made me really think about the whole backup thing, and I'm creating a disk image as I type this. The time that I spend on that will be much less then the time it'll cost to recover everything. Lesson learned ^^'

Living on the edge!

One or two years ago I managed to deploy a DDL change directly on the production server. As I knew there was a backup job which will run every day at noon and at midnight. So I run my script some minutes after noon. So far so good. But somehow I tested it badly in my test environment and the UI of the application throws error after error now in production.

Well, just revert the db to the latest recovery point with the backup, I thought.

It became clear then after a couple of minutes of searching the backup folder for the db backup that there was no such file. The youngest backup file was 3 years old.

Now what happened: The backup script had a switch "simulate=true" and then simulated a successful backup on each run. Therefore the monitoring system got no alerts for not correctly executing those jobs correctly. Then the monitoring job which should do the backupfolder surveillance stuck with green, because there was a valid backup file inside. But it did not check for a specific creation date.

Now this database is the one we need for doing our daily business and is really crucial. Therefore It was easier to emergencyfix the application than doing a rollback of the db 🙄

Well, not really a data loss story, but close to one.

Fucking tired of imbeciles

- who can't tell the difference between if a computer is hanged or the Mouse's cell ran out of battery.

- who constantly ping you when outlook isn't working, you fucking idiot you have to send/receive in order to get a reply in inbox.

- who have deliberately blocked .vbs script which takes backup of Outlook .pst files and keep complaining at the end of the day while I'm fucking about to leave.

Good news: You never have to backup the data on your computer and mobile anymore. In case of a crash, you ask the Facebook to send us their copy.

*me working at a huge company as a customer*
Ok, show me what you got.
* Company throws some of the most gruesome and ugly scripts at me*
HAVE YOU EVER HEARD THE WORD INIT SYSTEM? HAVE YOU EVER HEARD THE TERM PRIVILEGE SEPARATION OR BACKUP? DO YOU KNOW THAT A SVN REPO IS NOT SUPPOSED TO BE 500GB BIG? AND A JENKINS JOB SHOULD NOT RUN 8HOURS!
Company: you ain't have seen nothing yet.

And they were so right...almost can't bear it anymore

So I spent over 200 hours recovering a raid array because the the business that hired the company I work for tried to do all the work in house. Now I'm to the point of trying to quote a new server setup to the company because the last one got hit by lightning. My quote $8000-$20000 in just hardware alone. If im going to do this I want to do it right. Twin servers running xenserver holding virtual machines with a high-quality Nas to hold the virtual machine. Then have the vm's being imaged to two off site backup devices in two different locations and a cloud backup. My boss comes in after me talks to the guy in charge and tells him all that is needed is one server holding all storage on it just like the last server that died and one off-site backup for $4500. How stupid can someone be who has been doing this for over 20 years? Oh btw the software running on this server will be 911 dispatch, jail records and the database for fine payments. The sheriff making the final call me and my boss are meeting with him tomorrow if my boss tries to undercut me I'm going to tell them both that if the same shit happens next time they can spend the time themselves trying to recover stuff because I done the over 200 hours in just short of two weeks.

Linux software RAID and LVM are pretty powerful.

Bought a new server case for my home file server / VM host. 3U with 16 hotswap bays. Had 2x software RAID1 mirrors already with everything on them. Inserted 2 new disks with system running. Created new RAID10 array using these, with their mirrors as "missing".

Created new physical volume. Extended volume group into it, then used pvmove to transfer every logical volume across. Shrunk volume group to no longer use the old RAID1 array, disassembled that array, added its disks to the new array... Now just waiting for the mirror disks to sync up.

All this, with the system and several VMs still running.

And with a backup, of course ;)

So, this was about 6 years ago, I had a small HDD of only 80 gigs dedicated for projects code, models, textures etc.

I didn't use GitHub or anything as a backup.

One morning when I turned my pc on I could hear a metal on metal-ish sound, no idea what it was, when windows finally booted ... And I wanted to start coding again, the 80 gig HDD was unformated like brand new ...

Few hours later I gave up and opened the HDD, the arm fucked up the disk inside ... Rip

I started backing up my shit ever since

I'm ashamed of it, but I want to share my tifu-story:
My colleague asked me if I could rename his windows user name because he married and changed his last name. I changed it in the Active Directory, but he got some problems when he wants to log on. On every startup his old name appears. Simpliest task. Let me google that.
Easy going, let me just change this registry entry. Reboot. Old behaviour. Okay, I changed some of the other entries. Reboot. Yeah, his new name appears. But wait a moment. Windows just nulled his entire user profile and deleted all the data. "oh, haha you have a backup, right?" - "no, I saved everything on the desktop, all my work is gone!"
But at the end, the boss was mad at HIM, because he doesn't used the file server or any backup system.

i am not a smart man

Bad: Delete your production database
Good: Have a backup
Bad: Can't reimport it because your backup procedure uses scheme that are no longer supported for import by your cloud provider
Good: Backup are plaintext and somehow easy to parse
Bad: Spending the rest of the day writing scripts to reinsert everything.

End of the story: everything is up and running, 8hours of efforts

I was doing some maintenance on a production server for a game hosting company (Minecraft hosting, for those interested). A week before, I had created a backup of an account directory before trying to solve an issue, I now wanted to remove this directory.

Since I am way too confident in my ability to not mess up, I was logged in as root.

Instead of typing `rm -rf ../` (I know using -f is a bad idea), I typed `rm -rf /`.

The distro we were using did not have any protections built in.

The directory I wanted to remove as gone, but so was the rest of the server once I realized what I had done.

For two projects, I have been in a solo work pattern, been a time bottleneck, and been irreplaceable on the projects. Four months ago I told management, "If anything happens to me these projects will be in trouble. I want to train a backup. I can't sustain this momentum. It isn't good for me, or for the success of these projects."

Four months later I still have no backup. They decided to diversity hire some new developers in the wrong area and now there is no money for a backup for me. I can't do all the work on both projects as a solo developer. I could have if I wasn't pushed into doing trial and error development on a poorly defined MS Dynamics API. Since the projects were behind schedule the customers lost confidence in the company to deliver. So the executives railroaded both project managers to save face.

Instead of addressing the development issues they did a bunch of other silly things. I got a job offer lined up and issued my resignation. That news absolutely exploded. After resigning my executive decided to say how awful I am in front of the customer in an attempt to save face for the company. The customer contacted the recently railroaded project manager and asks why. Former project manager tells customer, "You noticed how much faster the development of that part of the application went when he joined. You noticed how much better the quality of the project was. What do you think is happening? Do you think that a very good developer and an experienced project manager are to blame for the failures here?" So the executive is 13/10 pissed off because I may have accidentally struck a death blow for millions of dollars of business. I committed to taking care of the handover to the customer, and the company can't afford to get rid of me without completely losing confidence of the customer. The developers that I work with don't blame me at all and they are disgruntled that executive tried to character assassinate me and realize that it could have been them. I sense that I also may have initiated a developer mass-exodus. So the last few days have been the most stressful of my career but none of it is sticking to me because I followed all of the correct process.

You play stupid games you win stupid prizes.

I specifically asked my employer when fix time is, whether I get a work laptop, and whether WFH is optional, because

- I'm a night owl and don't function until 10am
- my personal laptop is slow as shit and I don't want to put Windows on it
- I don't have a decent chair at home yet

- client team agreed on fix time starting an hour before what's in my contract, and PM made it clear that they expect to be able to call us an hour before and two hours after (that's what fix time means unless I misunderstand)
- I got a crap backup laptop after a week of moaning, with promise of a better one two weeks from now
- I won't get an RFID card for weeks, so I effectively can't enter or leave the client offices

Two days ago I wrote the deployment instructions. 5 lines. I sent them to the devops four days before the release (two days before usual).
A colleague of mine leashed out and had me send another message to say to ignore my instructions because they "generated too much entropy" he is releasing too his application and we should create a single instruction file. Okay, I see no reason to do that nor how that helps the devops. A longer file is not easier to understand than a smaller one.
Today the devops deploy our application. They make a backup of the new files and promptly overwrite the original copies with the files from production.
I lost 3 hours today. My colleague is refusing to communicate the error properly to the devops and I have a meeting in 20 minutes. I love my job.

Was in the middle of working on a game I had been working on for a couple months but had the original copy already corrupt so I was working on bringing it's backup up to the originals point...

Suddenly the power went down mid save, turned the computer on aaaaaaaaand it's corrupt, ended up cancelling the game because I didn't have time to rewrite and build everytbing from scratch again...

Now I don't use hard backups, all gets backed up to the cloud for easy roll back 👍

I once accidentally deleted the live versions of my websites instead of the development versions (which I wanted to delete because I was going to start over from the live versions.) After several hours of digging through backup folders, I finally found the latest backup files, which were a few months old.

It took me a few hours to get the backed up versions to the same version they were when they were live. In all this, I have learned to keep the live and development versions of my sites in completely different locations.

Recently made a sub 750 euro in home server with raid 1, to back up all pc's laptops and smartphones in the house to. Never been better!

Using a simple little daily backup tool on all pc's, and another app to sync 2 way to my phone, i was able to have all my data safe on that home server.

It even allows me to edit content on my phone which will sync overnight, because of the way usb access is shit on android since.. 5.0?

I am loving it! Worth every penny and week of setup effort.

Forgetting to write that WHERE statement, on a production database, during a serious case of Schroedinger's backup system, that failed.

....
oops

Seagate: A reliable source of unreliable NAS Drives. Rest assured, that they're gonna fail way before everything else, so that you're warned, when your other drives may not last much longer too ◔ᴗ◔

I stopped laughing, when my NAS' external Backup Drive, a Seagate, started throwing I/O Errors ๏̯͡๏

Me: Alright Derwent, don't fuck up this database update. There's no undo button and no way to import a database backup so you gotta be extra careful or you're going to have to spend hours writing a whole bunch of regular expressions and sql statements to sift through an 11mb database dump and figure out how to restore 59 thousand records to the correct state. Let's practice this transition on a staging server first and make sure we get it right
Me: I got you fam *presses the wrong button*

TIL that you can plug a mouse and keyboard into a Samsung phone and use it to interact with it like you would your finger. Now before you say this is such a useless feature, because of this, I was able to recover my backup from my screen shattered phone (really fucked it up so touch quit working) , and transfer it to another phone in a matter of minutes. To whoever thought of this, thank you so much :).

Oh no 😱
.
So I have a database with 12 tables, It grows really slowly and it's not really important, so I just do a manual backup once in a while.
.
Today, I wanted to do a backup, and realized that the content of the only table I cared about has disappeared.
.
I miss you Data, rip

Hi everyone, I've a desktop and in my area power cut is quite frequent. Although we've backup power, but sometimes it takes ~15 mins to come back.

Is UPS only option for desktops? Laptops nowadays have so long battery power, why there is no good option for desktops. UPS usually stays for 5 mins. Could you please suggest something better, as I've seen lots of desktops in posts? Thanks.

I am seeing a trend on here, where people dismiss a technology based upon their experience that they cannot use it first try, even though they clearly lack experience or knowledge about the proper usage.

Also people seemingly tend to imply self explanatory at various topics ranging from relatable broadly known experiences to small nieche opinions.

How is that? Since when do people, especially programmers, think they do not need to explain their viewpoint, even though there is not a clear indicator as to why? Stating an opinion without any backup to the claim is just a void call in the wind. Of course i know that user X thinks that Y is his or her opinion. But what good does it do when i can't relate / understand or discuss this opinion?

Well... Just last week one guy somehow completely broken our production server while creating an WordPress using Ghostscript for some reason. First this CMS users 100% CPU, then something has happened and whole server couldn't get up. Admin had to restore it from a backup. There are around 7 client on this server and all of our projects.

Just got my laptop back from the store, after having sent it in over 6 weeks ago due to a faulty keyboard. I had made a system image of the hard drive before I sent it in, so I could just restore it and have it ready to go. So I get the backup restoring, and at around 75%, the laptop died. I forgot to plug it in.

I am now currently downloading windows. This is going to be a long night.

Started a new job as junior developer. One of my first task was to sent a simple notification on an event in out product. Write the code, test that it works, push to devops.

Code compiles, tests pass, it’s deployed to internal test env. Check that my notification works in the test env. No problem.

It’s deployed to the customers test environment. It works and customer accepts it for prod.

We release to prod and of course it fails. Seems to be a simple string.Format that fails for god knows why. After 3h of debugging on prod without success we decide to roll it back.

Today we decided to try it on a backup of the prod db since one of the strings was taken from the db. Still working. No matter what data I input when trying it locally it still wont reproduce the issue we saw on prod.

Fuck this

Rant on me myself.

After being a professional coder (ie having a bachelor degree) for 11 years now, I finally have a decent and reasonable backup.

I use borg to backup to my raid 1, which is local, in my corridor near the ceiling. I use a Intel NUC with two external USB3 HDDs attatched. As I already had data on them, I went for a btrfs raid 1.

The second level of my backup solution is my brother. It's 50km to his flat. He's got a banana pi with my third HDD attached. I connect to his pi via VPN. The VPN is done via an AVM Fritz! Box. No ads, I just like those boxes (modem and router).
The backup is encrypted, of course.

Now, after ten years, I finally got a decent backup solution. Wow. This feels great! 😎

Accidentally drop a column of a table and without realising that take is in production,..... luckily I have backup....

My laptop charger is dead and my laptop can't work without it. So, basically I can't even look at code.

Colleague calls, says there is a problem with package.json and it requires my immediate attention as the APIs need to be deployed.

Me enters Sherlock mode, and remembers that I have a git hook which took a backup of my code every time I pushed and saved it on my headless tiny CHIP.

I get excited, and do an SSH from my phone, hoping to see the faulty code/file. But all I see is an outdated repository because I am an idiot who forgot to turn the fucking CHIP on after I shut it down for cleaning.

This is the most anti climatic ending I have been ever part of.

I love working on legacy products. You just need a good shower and possibly a therapist after.

- Sensitive data sent over the internet encrypted with DES (not even 3DES). Guess it doesn't matter that the key (singular, for the last decade) is basically 0123456789ABCDEF.

- Client databases with open default port, admin/admin superuser.

- Critical applications (potential for substantial property damage, maybe loss of life) with a single point of failure and without backup.

Suggestions, to slow down a bit with sales, so we have time to rewrite this steaming pile of crap are met with the excuse: be more pragmatist, this is standard industry practice.

Some of this shit can be fixed on my own time if my conscience nags too much, but others would require significant investment of time from multiple developers, which would slow down new business.

Guess the pay is ok, so that's something...

!rant, throw everything away

When you spend 9 hour at work, 2 hours in that fucking exploded bus, tries to spend time with friends and family, spend enough time with that one special person, try to sleep descently and manage to work on your personal projects during that two hours in the bus, and that each day, each week, the whole year.
You need a lot of motivation!
But when today I loose two months of work because of a hardware problem and that (because I don't have internet in the bus) I didn't backup on GitHub , I just have lost all motivation and will!
I just can't anymore!
FML

Worst prod scenario experienced - on site in small African country working on CRM/billing system my colleague was testing some new SQL and after finishing decided to drop and recreate the DB. She thinks the process is very slow and suddenly realizes she is dropping the prod DB. In a panic she shuts down the system and starts doing a restore from tape, but is so stressed out she writes "tar cv" instead of "tar xv" and overwrites the backup with the broken DB. Took a while to clean that one up...

Here is my day.
1. Mac wanted to perform an update.
2. I said Okay, Do it.
3. It took sometime, I thought WTF let's force reboot.
4. Shit happened. I am unable to boot as install is corrupted.
5. Reinstalled a fresh copy. I didn't have a backup.
6. Realised that my two days of work is gone since I haven't pushed the code to github.
7. Found out that I made a docker image with all of the latest changes.
8. Now trying to decompile and rewrite the code from the jar in docker image.

Rant at myself for being a moron.

Manually tried moving some InnoDB stuff around on a local server and corrupted a load of databases, with no backups since June 28th. Spent all day yesterday trying to recover with no luck 😑

Lesson learned: need to backup databases more regularly. Any good tools?

1) Learning to make Android games with Godot3. Really awesome engine to do this. I was impressed when I found out it can use adb to deploy to my phone directly.

2) A sort of a modular multiplatform backup service with optional on the fly encryption/decryption and available for all devices

My biggest data loss and also contributed in me getting into computer stuff was when dad formatted the computer before I was able to take a backup, felt so bad at that time it had all my photos from school with friends.

So instead of crying in the corner and me not knowing they can be brought back, at least half of them, I started learning how computers work, how software work, what type of software is out there ...etc. Though that brought more work for dad having to format my mess every month of so XD

But I ended up learning a lot of new things. Then one programming class at school sent me into the dev world

I want to cry... Fuck it.. shiit. .. :( :( ;(

Wasted half of the Weekend to Setup MySQL on my vServer which uses ssl encryption, have specific User and so on.
Thought: well, the User mysql is not so good as a Name. Drop it, you don't need it.
What did I? Instead of Drop User mysql , I typed Drop Database mysql.

Fuck that fucking Shit. I'm so sad right now. Broked the complete MySQL Database. Nothing is working anymore. And the server is new, I've Just made One Backup. Deleted this a few hours ago.. also accidently.

Help me :( Shit :( so sad :( Now, I don't have Motivation anymore to work with the vServer :(

Client be like:
Hello,

could you please restore our database from today's backup?

At a first glance - nothing out of the ordinary. Daily backups are standard...

Until we get the backed up snapshot running.

MySQLDump is somehow... Stuck. It... Doesn't seem to be doing... Like, anything. For ages. Wtf.

So we check the database. Connect, change scheme and... The commandline tool gets stuck, too. Weird.

So a layer lower, we check the datadir and... ls... After also getting stuck for a bit, lists about 500k files O_o

Yea, dumping a database with roughly ~250k tables is not fun. No wonder it takes ages.

When I rented my server I uploaded my webpage (including resources like videos, images etc) which is about 150GB as .tar and extracted and setup all that stuff and deleted the backup from my PC. The uploading process took me about 4 days. I opened the site of my server provider and reloaded it.. Aaaaannddd whoops. All data gone.

On my server hosters webpage when you click the reinstall button for installing a Linux image you get returned to the main page of that server after it finished installing. If you then reload that page which basically only shows some monitoring diagrams and shit the server gets reset again.

Damn. I lost so much good porn on that day...

As many of you might know, the PYX servers are down. It happens that I run an Android client for PYX, that was obviously a tragedy for me. I didn't give up and I've immediately setup a backup server, then due to lack of resources I had to shut it down, but I provided a list of servers run by other people.

Yesterday I've updated the app once again to do some fixing. Today, this guy leaves a review: "Absolutely useless until they bring back the servers. Why update the app when literally NOBODY is playing??"; Why am I updating the app?! Jesus Christ, why can't I update my app?!?! Should I delete it from the Play Store just because some servers are down? I get it, there are a few people playing, but please, don't fucking say that the app is useless.

This kind of people makes me very angry.

recently i prided myself in my high ability to google stuff but i just blank at this problem:

i have 4 HDDs with my photos on it. They are more or less backups of each other, but not quite. The folder structure is convoluted and i am dreading this task since years. I now want to move to a better backup culture and save the data i really care about.

Problem: i may or may not inserted new photos in some versions of the hdds and not in others. So they are like [Photo1], [Photo2], [Photo3] and [Photo4] but [Photo1] contains a,b and d content, [Photo2] contains a and b but not d, [Photo3] contains c.

Now i would like a program that just takes hashes of all files present and compares them and finds differences among those 4 folders so i can combine them in each other. Additional problem points for a being in a different subfolder on [Photo1] as in [Photo2]

Its probably some backup software that can that, but i dont know which one.

Whelp?

Someone's guts will be torn out tomorrow and put up on a nice clean razor barbed wire ...

I was wondering what the fucking fuck messed up my brain - till I realized that some dev mixed up the timezone on one of our servers. Dunno how the dev managed it - but the end result was not funny.

Due to the difference in time strings the newer backup had an older timestamp - and vice versa.

Which - when you want to do mass clean up and migration - is a very fucked up thing.

I had to manually check dozens of backups to make sure I got the right ones...

-.- knife goes in, gut goes out. Thx Bart Simpson.

Please, share your website backup strategies and practices - I have a simple php/mysql webapp and files don't actually have any backup other than the fact that they're also saved in a dropbox, and for DB I have a cron job that will export it daily and send it to my email.

How do you do it? How large are sites/app that you're backing up?

TIFU by showing login data during presentation

I was presenting my school project when my teacher asked if I could show him the source code. I said ofc, just let me login to the FTP server. I completely forgot that it was also shown on the big screen, and a random funny student logged in and tried to replace the index file with a joke file. Of course, he didn't want to make damage, so he made a backup. But this backup caused the problem, because he connected to the FTP through Windows Explorer (wtf?), and when he made a copy of the original file, it was renamed to "Copy of xy", but in a localized version, which contains special characters. Because of these characters, some FTP clients couldn't even connect, others just couldn't interact with the file. No download, no rename, no delete, nothing. After trying out like 8-9 FTP clients, I just remembered that I could rename it in PHP. Well, it got deleted instead of being renamed, but at least it wasn't there anymore. I have spent like half more hour with searching for a backup version on my computer until I found it.

TL;DR: showed FTP credentials during presentation on big screen, random student accessed and renamed a file, special characters in name fucked up the server, luckily I found a backup.

Fuck whoever is responsible for the backup and restore features of ADB. Luckily I had a backup in a different format, but if it was up to ADB's shittyness I would've lost all my data.

Decided to get myself a new phone as the 2013 model is getting morally obsolete. I can still flash Lineage/Android10 and it will run it. But the apps (e.g. Google Maps) nowadays are such a performance hog it can't cope.
So I've searched through gsmarena, prioritizing smaller phones, picked myself a candidate and had it on my desk after few days.
The 2013 mindset still the same "do the backup before touching the phone in any way". How do you do backup? Unlock bootloader, boot/flash TWRP, run backup.
I've realized only after the unlocking and some googling, that the unlock automatically deletes TA partition and stored DRM keys. So advanced licensed features of the phone are gone. Also there is no way to lock the bootloader again, so I've lost the SafetyNet validation too.

tl;dr: I've fucked up my new phone as a first step after I got it.

Dropped my trusty old Note 2 backup device this morning and it just keeps on ticking. No smoke just a nasty cracked screen. Sort of gives it character 😊

The coolest project I ever worked on wasn't programming per second, though it involved a bit of scripting. The company I worked for had an FTP over TLS backup solution and it was put together with glue and paperclips by a guy that hadn't the slightest idea what he was doing. In order to conform with the insurance, data had to be encrypted. I setup a raid-ed server with full disk encryption on the raid volume that fetched the key over the network at boot from another secure server. I wrote a series of scripts for provisioning users and so on. The backup connections was sftp using a ssh tunnel, the users were chrooted to their own home directories, and were unable to open shells. The system was 100x more robust and secure than the original. I set it up on short notice and received absolutely no recognition for saving the company's ass, but it was definitely a fun project.

My company uses a management software to store all sorts of documents. A colleague wanted to test their API.

In a meeting with management he reported that a backup of all receipts was done in a couple of minutes.

They initially thought he had download the files one by one using the browser interface and copy/paste to individual folders... Mad mouse skills my colleague has 🖱

This was more than 15 years ago. We migrated a bunch if data (home to a new server and repurposed the old one, the same night. This was not the first task on that allweekender, so it was around 3am on Sunday, with very little sleep, when I had to copy the data. I did that by logging in as admin and copying with Total Commander. Obviously, even admin did not have the permissions to some folders, so a lot of financial data were lost, as the users found out on Monday morning. We had no backup. Old server was not only reformatted, but the disks were used to build a different raid set. Luckily, one of the users who had access to this data kept a backup on a flash drive. (If you're wondering, I should've used robocopy with backup mode)

There is a pretty large blackout going on.

At one of our customers a 20 years old sun was running. Backup power didn't suffice.
We will see whether the drives spin back up once power is back...

Quotes are paraphrased (unless *) to protect the incompetent and stupid (or more the case: client and I'm reducing risk of exposure)

Situation: We have a program that opens sqlite database files. Occasionally new versions of the program needs to upgrade these files.

Program UI: To proceed you need to upgrade your database. It is recommended you backup your database before proceeding. Hit Yes to continue or No to abort.

Client: How do you back up a model once it has upgraded? If I hit No the program closes leaving me no option to backup the model.

Support: *The easiest way of backing up a model before upgrading is creating a copy of the file and keeping it in a separate folder*

Client: *Haha forgot about being able to do that outside of* <program name>

TL;DR: engineer in technical role who is probably getting paid $150k+ forgets it is possible to make a copy of a file.

Today I basically threatened my whole team that if they weren't going to help me take a backup (somehow don't have access issues to the machines) I would just deploy the thing and if it crashes then just fck it...

I already busted my ass for a whole week on top of other issues and you can't even help me run a few simple commands...

I just stared as a trainee at a webdev firm.. I'm starting a company with my friends parallel to this. I never thought my life would be waking up and doing 13 hours of WordPress.. Today a customer asked me to speed up her website, it had 30 plugins all of which she uses..moving the cache erased the plugin-generated index page, it was nowhere to be found even after pulling backup..

Now I've been home for four hours.. trying to work around a "responsive theme" a customer picked.. It should be called Worsedepress

Best: take a job as a data analyst. 1 year later, re-write and re-deploy the entire backend following correct security concentions and well-hashed-out data models.

Worst: attempt to backup a hard drive using dd, just to accidentally brick the laptop (because it had some security layer the school put to prevent just that)

Bestest: use knowledge acquired at my "best" story to nuke windows on bricked laptop. Then extract the leftover data using dd and a series of recovery tools.

I did a backup of my computer on a new harddrive. I know it's on me for not checking this, but how difficult it could be for the software to check if there is enough space on the hd for the whole backup BEFORE starting it, instead of in the middle of it?? 😥

- working on a personal project
- got angry at windows for sucking so bad at running fucking vs code of all things
- banged the palm rest on laptop in rage
- windows freezes
- restart
- harddisk died
- lost my collection of notes from college
- lost all my photos
- but most importantly, lost my progress on a project that I was working on and hadn't git push
- FANTASTIC

Lession learned. Always have a backup. ALWAYS.

So I got the LSTM working in keras.
Working from a glorified tutorial.
Why the fuck do people let their github pages go down with no other backup?
Especially if its a link in your blog?
Why would you do that and not post the full script (instead of bits and pieces interspersed with *partial* explanations)?

In any case, its working and training on a test set and examples just to debug my own understanding of the process.

Once thats done I can generate some training data and try training on a small set. If that goes smoothly and the loss looks like it is heading in the right direction, then I'll setup the hardware for the private cloud and start writing the parallel computing component.

Dev DB just auto shutdown in the middle of a restore.

From an online backup.

With NORECOVERY.

Shit.

When I started doing frontend development, I was quite shocked with how people managed to cowboy code their way into building fully functional products with a decent paying client base.

I am talking about fully function SaaS with payment gateway and all, but no version control beyond full backup copies, and spaghetti code everywhere you can literally bring the website down trying to change the homepage design.

... and the startups that managed to do better, some of them forgot the .git on production exposing their entire source code *facepalm*

I remember the day when I mistakenly hit :
# rm -rf /
instead of :
# rm -rf ./
The . changed my day that day. Thank god that the files and configs in the server had a backup in my PC. :P

Well today ended in a bang! Had a typo in a dd command and nuked my entire work VM. Last VM backup august 2020. Time to retrace the entire work environment for a year. Not much work was lost thou as most of it was already pushed.

Rookie me,back when I was making my first Android app...
After a lot of hours put into it, finally finished it...pretty much was ready for deployment...some final touches...but oh wait... I was messing with some files-wanted to delete something and misclicked the whole folder...well my brain farted for a moment and clicked yes-I managed to erase the whole fucking app I was working for months...!
The whole world shut down at that moment! What the fuck did I do?...
In this point I want to thank jetbrains for their magical revert button....
Moral of the story: Learn Git, backup everything and don't be too excited and fuck up tremendously...!

This one was from my Tech Lead, She had to update phone number of a customer in Database on production server. And guess what she forgot 'WHERE'. Next we were facing each other with poker face. :|

p.s: fortunately we had backup of just 4 hours back. Still we lost data of about 100 people.

If your project gets fucked up beyond repair, for example by your IDE (I'm looking at you, Android Studio) try this:

0. Backup any ignored but essential files in your project (e.g. secrets) outside of your project directory.
1. Close your IDE.
2. git clean -xdf
3. Restore any backed up local files.
4. Reopen the project as a new one in your IDE.

This is awesome, because it cleans up everything non git and not committed. So any local project files configured by your IDE will be nuked, which allows for a clean start. Also, all your locally committed work is preserved.

BTW, if you really need to start over (even with git), then just remove all the things an clone the remote repo again.