Ranter
Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
Comments
-
@PrivateGER Have to run it as root! Also, to unchattr, use the -i param.
Note: you CANNOT see the chattr status of a file with the generic ls command, you have to do "lsattr" and if you see an 'i' before one of the files, it's chattred. -
@PrivateGER Second note, sometimes when a program can't write log output it can crash so be careful with this 😅
-
@neeno what would you have done at 3am when all you want is sleep? Extinguish the fire out and deal with it next Thursday.
-
If I were you, I'd chattr / and get this done, this way we make sure server never gets full again, and no more late night calls
-
How come you didn’t wake up 1 hour later with the program doing the logging crashing because it overflowed in memory and couldn’t flush the logs to disk? 😦
-
@brogrammerology That wasn't our responsibility and we didn't monitor that as it... wasn't our responsibility
-
@gitpush Nah, the logging was there for a reason, they just needed to fix this issue.
-
@theKarlisK Yeah I'd do that haha but we didn't have control over the log file path 😬
Related Rants
-
3rdWorldPoison8Something that I'm utterly ashamed of. Had to add text message and call communication functionality in one of...
-
sleek17i work on a music streaming app. bug: playlist description shows there are X songs inside. But when you go i...
-
SortOfTested2The solution for this one isn't nearly as amusing as the journey. I was working for one of the largest retail...
Waaaay too many but let's go with this one for now.
At my previous job there was a web application which was generating about 1gb of log data a second. Server was full and the 'fullstack engineers' we called had zero clue about backend stuff and couldn't fix it.
Me and another engineer worked our asses off to figure this out but eventually the logging stopped and it went back to normal.
Great, right?
For that moment. I was the on-call server engineer and at like 3am I got called awake because this shit was happening again.
Sleep drunk with my phone I ssh'd into the server, not sure about what to do at first but then suddenly: let's chattr the goddamn log file...
$ chattr +i /var/log/logfile
Bam, worked, done, back to sleep.
(this comment + param marks the file in a way that it can only be read until the mark is removed, so you can't write to it or move it or remove it or whatever)
rant
wk228