Ranter
Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
Comments
-
Me: There goes your weekend.
Also me, after realising that I'll be working on Saturday too: π -
That should be no issue.
That is, if there's a good suite of tests & a deployment pipeline which allows for rapid rollbacks.
Which... often isn't the case. -
Friday afternoons are obviously is a huge no-no, but I'm gonna argue Friday morning deploys should be fine.
If anyone is saying a deploy on Friday at 8:30AM is mega dangerous they're basically saying that it could take more than 6 hours after a deploy to detect and fix an error.
To which my response would be : "Then how the fuck do you dare to deploy on Monday at 3PM?"
The way I figure: if you have decent monitoring/logging and a decent sized user base - any potential issue caused by a deploy should surface within 3 hours.
If you deploy on Friday 9AM and there's no issue at 3PM - it's unlikely the issue will surface during the weekend.
EDIT: if you have a very low amount of users and/or poor monitoring - this might not be the case though. -
If your customers are using the site only on regular office hours, friday evening is the perfect time to deploy. You can test and fix bugs the entire weekend without anyone noticing.
-
rootinit1424y@Oktokolo It's true. Outages are the number one reason why deployments are done on Fridays.
-
hjk10156964y@bittersweet I find that deploying changes that do not impact data in a meaningful way are fine. As soon as existing data gets modified or important new data gets collected it gets really hard.
You can't just do a rollback without crashes or incomplete datasets. You need a way to actually revert the data changes. Sometimes when going forward again you have to deal with incomplete or overcomplicate/wrong data (from failed attempt).
The worst issue is when a change slowly corrupts data. We had that once and it took a month to notice... The code fix was easy but it took a long time to recover without accidentally reverting (new) correct data. -
@hjk101
Yeah definitely. I usually do not touch our financial system on a Friday for example, even though it's rather well tested.
But a new feature which doesn't edit the structure of existing database tables? We deploy those all the time, also in the weekend and middle of the night. -
@bittersweet Totally agree that's a reasonable approach.
I think many devs take things too far, almost to a religious level, when claiming that not a single deploy can be done between friday to sunday, even if it's a single line of code. -
zigmas584yThis feels like there's a lack of strong CICD where it would rollback on failure or a human would have the possibilities to do it well
Related Rants
It's Friday and guess what?
We are fucking deploying on prod!
rant
prod
friday deploy