Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
Search - "luigi"
-
Well here's how I see things going:
Intel and AMD ditch their assembly architectures for Scratch, because drag and drop is very popular lately.
The Boolean is renamed to the biggot by SJW leaders for only supporting binary views.
You must first ask consent to add an item to a linked list, because forcing two items together promotes rape culture.
Apple removes the "h" and "7" keys on all laptop models and gives no reason for their actions.
Linus Torvalds grows an extra middle finger, and it still isn't enough.
Nintendo makes Mario gay and Luigi black to be more inclusive.
LG makes a curved monitor that curves away from you rather than towards you. People buy it in confusion.
Everyone makes the same ad revenue on YouTube, and it is rebranded to OurTube. Luckily, they were able to keep the color scheme.
People finally realize that machine learning is just math, and stop using it everywhere. (Just kidding lol)
AMD and Gucci merge. Nobody understands why.22 -
So I am driving home and stop at a light. Some dude in a truck behind me starts flipping me off at the light. The road is 45mph and 2 lanes. I am in the right lane. So when the light changes I speed up to 35mph so he can pass me. He decides to tailgate me and honk at me. So I stay steady and he eventually goes around me. I keep my distance. But it looks like he is going to the same place as me. Before I get to the road I want to park for my destination he takes the same road and parks his truck and trailer where I normally park facing the wrong direction. Okay, wtf, but okay. So I go further down the road to turn around and park somewhere else. He guns his truck to cut me off from that parking spot. I have to hit my brakes to prevent hitting him. I raise my hands in the are like "why?" I then finish turning around and head back to my parking spot and park. So this guy tried to cause a car accident. At this point I took my stuff inside and put it away. Came back out and called the police to report the incident. They said they cannot identify a crime, but I can fill out a police report. While I am on the phone with the police this guy leaves that street giving me this bizarre deranged smile. I refuse to engage. I spent the next hour filling out the police report. In the process I find out he lives on that street a few houses down. I am nowhere near his house, but he seems to not like me parking on that street. This guy must have seen my car on that street before and decides to randomly road rage. I gave his name and address to the police. My intent to build a case file if he doesn't knock this shit off.
So now I gotta buy a fucking dash cam and put it in my car because of some nutjob plumber. I have nothing against plumbers, but this guy fits the definition of knuckle dragger. His name isn't even Mario or Luigi, bummer.
Another thing that might be related is that during the winter somebody dumped a ton of snow onto my car when it was parked there. It looked like it was on purpose. If this is the same guy this guy drove his snow plow 4 houses down. Definitely has mental problems.10 -
TLDR;
Side project update.
Made simple nlp library in python and published it’s first version to open source.
Now I can feed it with parsed pdf text.
See rant https://devrant.com/rants/2192388/...
Why ?
Cause during reading book about nltk I couldn’t find simple extendible way to provide support for polish language and I wanted to abstract stemming, word normalization, tokenizer etc. so I can provide ex. different conditions for separate text files and don’t write much code what is an asset when you work solo.
It’s about 12GB of pdf public accessible law data I am trying to handle ( at first ) which is about 35000 files from last 90 years.
So far I automated downloading web pages and pdf documents from them. Extracting data from web pages and saving it to database. Extracting text from pdf files. I have about 5-6 projects to do all of it above maybe at the end I will put it to some workflow manager like Luigi or just run it by cronjob.
First thing for website version 1.0 part is find correlation between all documents inside law text using nlp library by building custom conditions. Then just generate directory structure and html files with links between documents.
Website version 2.0 is already in my mind but it will be creepy to make it and will take at least 1-2 months and I want to publish fast.
I have some pdfs with only images instead of text and tesseract worked quite good with them so maybe I will try to process them when everything go live.
Learned a lot about pdf as now I know that font in pdf is not always providing unicode characters ( stupid form of obfuscation) so when you extract text you need to build glyph vector to text map for every font.
Pdf is full vector representation - just like svg - what is logic if you think a bit and know that some printers are running using postscript.
Let’s hope next update will be about flutter mobile app which started all of shit above. It’s almost ready ( except getting data from api I am trying to do and logo for release version ). It’s last piece of puzzle.3 -
I started working with Luigi, the workflow manager for a data-science project. Any input on how to test the Tasks or how does it compare to Airflow?