31
Takumo
7y

We have a pretty simple rule in our team:

Do not deploy to production on Friday.

Well thanks to the client being very slow to reply to me, they only signed off on launching the app at 15:30 on Friday, for a big campaign the app was built to facilitate starting Saturday.

Guess who had to bite the bullet and launch a new app into production at 15:30 on Friday.

Guess who got a text from his boss at 19:30 that there was a critical change required tonight.

Guess who was making code changes and deploying to production at 21:15 on Friday night while drinking Gin and tonic...

Nb This was a project only i was assigned to and came in as a rush job at the last minute.

Comments
  • 2
    I'm so sorry. Well your weekend is ruined. Hope you have enough to get alcohol poisoning where you won't have to do fixes all weekend even though its just a tad better
  • 4
    This sucks. Hopefully it all backfires and you can somehow say "see, I told you"

    I've gotten frantic calls at 1am on weekends about servers being down. Usually too drunk to care at that time and get to it in the AM.
  • 2
    @MadHatrix i have automated scripts setup to fix that problem. I usually get two emails from pingdom sayin down and up with 1m of downtime
  • 1
    @jckimble yeah. I use monitis. The one frantic call was from a previous client who's developer was hacking him after he quit. Haha. (his words). I still had access to his servers so was able to get in and lock out the other dev.

    The other times were from when I was a freelancer for the company I now work for. Since then, I was able to set up load balancers and dns failover for our main traffic servers.
  • 2
    @MadHatrix i use fail2ban to keep crap like that from happening. I use monit and a custom python script that hard restarts the server if for some reason a reisub moment happens
  • 10
    Us developers need to start acting like employees in other fields.
    Activate that out of office email at 5pm sharp.
    Somehow programmers have accepted being pushed around.
    time to start thinking like an accountant - if the customer aint done before 5pm then "tough shit \_(ツ)_/¯ see ya monday"
  • 1
    @jiraTicket definitely agree. Same with status in a company. Sales guys, marketing guys get paid more than devs in some places.
  • 2
    Never ship to production on Friday should be like the 4th commandment
  • 0
    @jiraTicket Well we're a small company of fewer than 10 people, we're a very close team and everyone tends to treat each other like good friends, there's not much vertical structure to the company, and my boss is the owner and has admitted things are though for the company right now.

    All this combined means i don't mind doing the occasional favour.
Add Comment