Working on a feature which heavies relies on a data pipeline. I noticed it is a couple of lambda functions calling each other ( Fuck you to the guy who made it). The best way to get sanity back is build a proper etl pipeline. Any suggestions for building a etl in python with reliability.
Options already considered
1. Celery tasks - Worked well but no overview of the single task progress across celery tasks
2. Airflow - Gives good overview but the docs make less sense than a 10 yr talking. Mostly because they introduced a new syntax and not everything has migrated fully yet. Also no support for reusing dags

Python
Git
Linux

With my wallpaper

Quack Quack

Undoubtedly the most common mistake that devs do : Ignoring your personal health, be it mental or physical.

I almost went through a burnout before realising things need to change.

Changed my lifestyle upside down after that
- Switched from wfh to an office job
- I cycle 12kms a day now
- Got a standing desk for myself to be more active
- and have a journal where i literally dump everything off my brain

This is so fucking relatable.
Everytime there's atleast one dumbass in the organisation who frequently does this exact thing.

I am happy about a lot of code i have written but most recently speaking, the fuck you github page mentioned in https://devrant.com/rants/4934026/...

Biggest challenge was to accept that no matter where you go, what you do, you will have to deal with stupid people.

They come in all ranges, starting from hr, interns, juniors, coworkers, code reviewers, seniors, managers, boss, clients.

And in order to grow in life, you have to learn to deal with them. Better even if you could make them a little less stupid.

Does it get any worse ?

Suggest some good accessories please... I got an amazon gift card to waste of $100

I knew this guy was pure evil.
Deployment on friday night !
And that too before Christmas.
Thank god Santa doesnt use Tesla

Monthly Update call
Me : I need 2 undivided weeks in the next 3 months to make some refactoring to our codebase, so we dont have issues in scaling.

Senior Manager (with years of tech experience almost equal to my age) :
Why would we need that, We are already hosted on AWS so we can just spin up more instances.

Me ( trying to hold the rage inside) : No it doesnt work that way, that will only hurt us more than help.

Him : What if we try with a bigger instance size. Its AWS, sure they will have a bigger instance.

Me : No, tha....
Him : (cuts me off) How about we use autoscaling and let AWS decide

Me : (Silently praying for a gun that shots across video calls.)

Rant
Why do shithead clients think they can walk away without paying us once we deliver the project !!!

So, here goes nothing..
Got an online gig to create a dashboard.
Since i had to deal with a lot of shitheads in the past, I told them my rules were simple, 20% advance, 40% on 50% completion and 40% after i complete and send them proof of completion. Once i receive the payment in full, only then i will hand over the code.
They said it was fine and paid 20%.
I got the next 40% also without any effort but they said they also needed me to deploy the code on their AWS account, and they were ready to pay extra for it, so i agreed.
I complete the whole project and sent them the screenshots, asking for the remaining 40% payment. They rejected the request saying my work was not complete as i had not deployed on AWS yet. After a couple of more such exchanges, i agreed to setup their account before the payment. But i could sense something fishy, so i did everything on their AWS account, except registered the domain from my account and set up everything. Once i inform them that its done and ask for the remaining payment.
The reply i got was LOL.
I tried to login to the AWS account, only to find password had been changed.
Database access revoked.
Even my admin account on the app had been removed. Thinking that they have been successful, they even published ads about thier NEW dashboard to their customers.
I sent them a final mail with warning ending with a middle finger emoji. 24 hours later,
I created a github page with the text " This website has been siezed by the government as the owner is found accused in fraud" and redirected the domain to it. Got an apology mail from them 2 hours later begging me to restore the website. i asked for an extra 10% penalty apart from the remaining payment. After i got paid, set an auto-reply of LOL to thier emails and chilled for a week before restoring the domain back to normal.
Dev : 1
Shithead Client: 0

Let the hate show

Looking for creative captions

People who buy firecrackers can be best crypto investers because they dont fear their money turning to zero in an instant

How men select clothes:
stack.pop()

How women select clothes:
Elasticsearch.search()

Question :
What is a better solution to host a flask application on AWS ? ECS or EKS or Fargate ?

Looking for personal experiences and opinions

Is it just me or anyone else wants more devRant cartoons from these rants ?

I really liked them

Recently i had to interview a guy with 10 years of frontend experience for a react developer role

Me : Do you know what ecmascript is ?
Him : Yes
Me : Which version would you prefer to use and why ?
Him : I dont use it. I am more comfortable with JavaScript.
Me : (totally confused) 😶
Him : (trying to be oversmart) I know you young guys prefer to use these fancy frameworks because you dont know how powerful raw javascript is.
Me : (Trying hard to not "react") Ok.

How would you "react" to this ?

This is just hilarious.

Finally something good in the name of Privacy. I hope this is NOT a joke !!!
https://blog.cloudflare.com/announc...

Dedicated to Indian Software Engineers. https://youtu.be/h9QNUcrjtOs

I wish any of my friends could understand it.

Finally something good in my life.

Have u ever opened a website and thought if u had the chance, u would kill their fucking frontend guy. Ya well i had to open a lot of such websites on a daily basis , so i found a extension that lets me change the website's css. After tinkering for a while, i came with this for the homepage of duck duck go.

Using devRant.

I have learnt a lot from everyone. I didn't even realise before that being a dev can be sooo awesome.

Thanks @dfox, @trogus.

My professor( 2 yrs ago) : Why r u wasting ur time on Python. Learn Java or .net , u will get a good job.

Now she asked me for python tutorials cause she needs it for her PHd. 😂😂😂

Most amazing game i ever played
https://alexnisnevich.github.io/unt...

Other suggestions please.

You run a bank with over 10million customers and can't​ handle a nullpointerexception error.And java ssly.