Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
-
@donkulator bad change with rollback steps, when it went bad, they adhocd a fix instead of rolling back that didn't fix the outage, but did stop alerts.
Service was down for 24 hours and we only caught it because the customer kept escalating the complaint
We had a production outage directly caused by our team not following a change procedure correctly. Now we're under a microscope and in a "get well" program.
They took over the daily standup for this high priority program and are organizing efforts in confluence instead of jira.
Now we have a confluence doc of what everyone is working on with someone changing the text status in a table by hand every morning along with the comments in a note section...
rant