Details
-
Abouta geek diggin' deep
-
SkillsJava dev, Linux/UNIX sysadmin, performance engineer
-
LocationLithuania
-
Github
Joined devRant on 2/26/2018
Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
-
wait, is @-red gone now too?? :o How come my profile score did not suffer a major impact... Wasn't he the one flooding us with ++s back in the day?8
-
Boi does it feel good to just take a weekend off and not to worry about anything, not to think about anything,... Just be and go do whatever your body tells to.
Feels like charging w/ a dedicated 120W charger, compared to a shared 10W one4 -
Half a day wasted. FUCK!
I use grafana loki and mimir/prometheus for telemetry. A few days ago I queried loki to see if logging is still working. Yesterday I changed the datasource to mimir, changed the query parameters to get metrics from another env, ran the query, and... Querier [mimir] crashed.
Wtf.
Error says it got too much data to chew on.
So I spend 4 hours playing with the querier and grpc limits, balancing between limit errors and OOMKills [2G ram].
I got suspicious about oomk. Why would it...
Then I tried to shrink the timeframe to 15min. Still oomk. Down to 5min -- now it worked. But the number of different metrics returned was over 1k
then I look once again at the query. And ofc it is ´{env="prod"}´
turns out, forgetting that you're querying metrics with a logs' query is an expensive and frustrating mistake. Esp. at 3am.
idk why it even returned me anything...7 -
[Blue pill]
stay in my current workplace [approaching the 10yrs mark], with an agreed salary and seniority raise, with a high probability of losing my current project [which is really fun!] in Feb next year and having to switch to another one, but keep all the benefits
[Red pill]
switch full-time to contracting with a potential to reap big bucks [x2-x4] and be free to juggle as many clients as I like, dictate my terms, become a shareholder, but lose all that warm and cozy certainty guaranteed by my current employer2 -
A company weekend in a homestead with a bathhouse and a cold pond.
After a good bathing [~x6 cycles] I'm in my bedroom [left the party early, really want to enjoy the calm and silence]. I thought it would be a good idea to charge my ITware overnight.
Apparently there's only 1 wall socket in the room. And now I have to choose: whether I want an electric heater to basically stay alive until the morning, or a full phone and lappy battery in the morning...
I made the choice2 -
When you can pass a {dog} as an {avocado} and work on it as a fruit doesn't help much. Especially when it starts to meaow1
-
Trying to build a 4-5 years old project (starting with Dockerfile builds). Fixing build errors feels like fighting windmills...
wtf. It was working perfectly fine 3 yeas ago!!
All the more motivation to start using nix for project builds.... Docker simply isn't reproducible enough...8 -
So yesterday (Oct 7th) I got this email, inviting me to a telemetry conference.
Does anyone have a DeLorean to lend?1 -
I don't know whether my keyboard needs cleaning, or I'm developing some sort of dyslexia , because I seem to be skipping letters and short words in my messages, or writing all te letters but in mixed up positions more often lately...6
-
I don't understand wtf is happening today..
- in project A, terraform suddenly decided to stop working with kubernetes-related providers -- the CA cert mismatch error. I agree, it should be not working, because there are 2 kube-api severs behind an LB. But why now??? Why was it working for the last 2 months, until NOW????
- in project B, terraform suddenly decided to stop working _correctly_ with kubernetes-related providers -- it doesn't find resources randomly, even though they are available and I can see them via kubectl get. TF_LOG=DEBUG shows terraform sending correct requests to the kube-api, but the response is a 404. wtf... I see those resources present in another terminal window, only using kubectl. wtf....
- my PR in github was commented, I wanted to ask a question seconds later, and I'm getting a 502 from GH
wtf... I can't spot a pattern and that drives me freaking crazy.
Is this the Friday's curse...? IDK4 -
A question for the people who say Macs are superior...
WHAT THE FUCK
I'm wrestling this iOS signing issue for the fourth day. How the fuck do people manage to build anything using tools broken by design and sold to them for the price of their mother.23 -
when you have 2-4x better network throughput accessing a computer next to you over WAN than over LAN .....6
-
What's it like to be an ITSupport in a public healthcare facility where average employee age is 60y:
Doc: Hello. I can't make this thing work
IT: Hi. What thing? Please describe the problem
Doc: I have _this_ webpge [red.: ITSD knows what page] open but it's not loading anything. It just shows a spinning wheel
IT: I see. Can you hit F5?
Doc: err.. a what?
IT: A key on the keyboard. F5. It's at the top row of your keyboard, slightly left from the middle
Doc: <pause>
Doc: Found it. Okay, I clicked it. Nothing's changed
IT: Maybe the focus wasn't on the browser.. Anyway, can you close the window?
Doc: ...okay...
Doc: <rumble rumble>
Doc: <catching its breath> Okay, I closed it. But I won't have it closed the whole day, it's 27ºC inside.
IT: <facepalm>.... -
Holy shit, it just hit me.
I'm an IT engineer who's irl also doing woodworking. And masonry.
Is this a dream life or what6 -
A while ago I was asking wtf is this new trend with using 0.0.0.0 as a target address for connect()'ing TO.
Turns out, I was asking the right questions. This nonsense will soon be blocked in browsers, as it's a dumb security issue.
ref.: https://oligo.security/blog/...4 -
> received message after decompression larger than max (16777217 vs. 16777216)
OH COME OOOONNNN!!!!!!!2 -
TIL:
How to become root w/o having to provide a password:
unshare -rm
no go ahead and bind-mount your own /etc/hosts (or any other file/directory) w/o affecting the rest of the system!1 -
What's this new trend with connecting to 0.0.0.0...? Since when is 127.0.0.0/8 no longer enough?
Does 0/0 offer to the clients smth 127/8 doesn't?6 -
fuck.. FUCK FUCK FUCK!!!
I'mma fakin EXPLODE!
It was supposed to be a week, maybe two weeks long gig MAX. Now I'm on my 3rd (or 4th) week and still got plenty on my plate. I'm freaking STRESSED. Yelling at people for no reason, just because they interrupt my train of thought, raise a hand, walk by, breathe, stay quiet or simply are.
FUCK!
Pressure from all the fronts, and no time to rest. Sleeping 3-5 hours, falling asleep with this nonsense and breaking the day with it too.
And now I'm fucking FINALLY CLOSE, I can see the light at the end of the tunne<<<<<TTTOOOOOOOOOOOOOTTTTT>>>>>>>
All that was left was to finish up configuring a firewall and set up alerting. I got storage sorted out, customized a CSI provider to make it work across the cluster, raised, idk, a gazillion issues in GH in various repositories I depend on, practically debugged their issues and reported them.
Today I'm on firewall. Liason with the client is pressured by the client bcz I'm already overdue. He propagates that pressure on to me. I have work. I have family, I have this side gig. I have people nagging me to rest. I have other commitments (you know.. eating (I practically finish my meal in under 3 minutes; incl. the 2min in the µ-wave), shitting (I plan it ahead so I could google issues on my phone while there), etc.)
A fucking firewall was left... I configured it as it should be, and... the cluster stopped...clustering. inter-node comms stopped. `lsof` shows that for some reason nodes are accessing LAN IPs through their WAN NIC (go figure!!!) -- that's why they don't work!!
Sooo.. my colleagues suggest me to make it faster/quicker and more secure -- disable public IPs and use a private LB. I spent this whole day trying to implement it. I set up bastion hosts, managed to hack private SSH key into them upon setup, FINALLY managed to make ssh work and the user_data script to trigger, only to find out that...
~]# ping 1.1.1.1
ping: connect: Network is unreachable
~]#
... there's no nat.
THERE"S NO FUCKING NAT!!!
HOW CAN THERE BE NO NAT!?!?!????? MY HOME LAPTOP HAS A NAT, MY PHONE HAS A NAT, EVEN MY CAT HAS A MOTHER HUGGING NAT, AND THIS FUCKING INFRA HAS NO FUCKING NAT???????????????????????
ALready under loads of pressure, and the whole day is wasted. And now I'll be spending time to fucking UNDO everything I did today. Not try something new. But UNDO. And hour or more for just that...
I don't usually drink, but recently that bottom shelf bottle of Captain Morgan that smells and tastes like a bottle of medical spirit starts to feel very tempting.
Soo.. how's your dayrant overdue tired no nat hcloud why there's no nat???? fuck frustrated waiting for concrete to settle angry hetzner need an outlet2 -
"best" server. BEST.
is the hedgehog stealing my wifi...?
Retrieving speedtest.net server list...
Selecting best server based on ping...
Hosted by NewMedia Express (Singapore) [9430.76 km]: 436.529 ms3 -
So I'm sitting on the swings, minding my own business, seing how best I could destroy this cluster of servers, when suddenly I notice SOMEONE IS COMING FOR MY COFFEE
"hi neighbour! What you've got there"5 -
I've never been a big fan of the "Cloud hype".
Take today for example. What decent persistent storage options do I have for my EKS cluster?
- EBS -- does not support ReadWriteMany, meaning all the pods mounting that volume will have to be physically running on the same server. No HA, no HP. Bummer
- EFS -- expensive. On top of that, its performance is utter shit. Sure, I could buy more IOPS, but then again.. even more expensive.
S3 -- half-assed filesystem. Does not support O_APPEND, so basically any file modifications will have to be in a
`createFile(file+"_new", readAll(file) + new_data); removeFile(file); renameFile(file + "_new", file);`
way.
ON TOP of that, the s3 CSI has even more limitations, limiting my ability to cross-mount volumes across different applications (permission issues)
I'm running out of options. And this does not help my distrust in cloud infras...9 -
Hmm..
My game changing caching proxy [mitmcache] in CI implementation works miracles in localhost. It shaves off build times significantly: what used to build in ~2min now builds in 18sec.
However, this doesn't seem to be true in CI... For some reason build times remain the same [more or less] when cached and considerably longer when the cache is cold/empty..
Damn it.
I don't understand why...
A week wasted. And I have to explain the client why me failing in this is a good thing, so I'd get paid
https://gitlab.com/netikras/... -
Since we're sharing traffic lights... Today I was running towards a green lad with a boner all day.
Talk about poor design choices, right...11