This is Alice.
Alice ++'ed my post about shitty internet.
Be like Alice.

“Yeah but you’re not a *real* developer”

Fuck. you.

I wrote 80% of this code base. I do 80% of the tickets/storyboard points. I do all of the QA. My nose is to the grindstone every fucking day honing this craft and sweating my balls off like a blacksmith staring into the red hot kiln while the sores of previous mistakes scream bloody murder from the unrelenting exposure to heat. I saw this amazing industry of opportunity, freedom and self examination and wanted in no matter what it took. I glued myself to every pithy resource I could possibly get my hands on and crawled through the muck and filth of it all until I could keep myself warm with the smallest spark of my own making. I stoked that spark until it became a fire and stoked that fire until I could set entire forests ablaze. I listened to the ungrateful people keeping warm by my combustion saying it “wasn’t hot enough” or “would have been a nicer colour if they did it” or “could have warmed up just fine jogging on the spot”. I made painstaking alterations to my ignition and watched my undeserving benefactors gradually be silenced and begin to sit quietly by the heat. I jumped into that inferno daily, was reduced to ash daily and emerged reborn daily. But you are right! I didn’t get scammed out of $40k+ studying technology in an archaic institution from instructors who don’t give a shit and answering “D all of the above” for 4+ years straight therefor my opinion doesn’t mean shit. Push your bullshit to prod and watch the server come burning out of the cloud as the apocalyptic swarm of angry tickets come flooding in why don’t you? Bet they didn’t teach you that in school. You’ve never poked around inside an open source codebase in your life. They are just a mystery boxes of magic that unless someone holds your hands with finely crafted instructions containing a 50/50 picture to word ratio you throw a hissy fit. Every problem that comes up instead of working to solve it you reflexively point to the first person in the room while thinking with your pea brain how you can possibly scapegoat them into taking the fall for whatever it is that’s come up today you couldn’t possibly understand.

Not a real developer?

Fuck. You.

*Interview*

Interviewer: We have an opening. Are you interested to work?

Me: What is that I'll be doing?

I: What technologies and languages do you know?

Me: I know Scala, Java, Spark, Angular, Typescript, blah blah. What is your tech stack?

I: Any experience working on frontend?

Me: Yes. But what do you use for it?

I: Can you work with databases?

Me: I can, on SQL based. What are yours?

I: Can you do big data processing?

Me: I know Spark, if that's what you are asking for. What is it that you actually do?

I: Any experience in cloud development?

Me: Yes. AWS? Azure? GCP?

I: Do you know CI CD?

Me: Excuse me.. I've been asking a lot of questions but you're not paying attention to what I'm asking. Can you please answer the questions I asked.

I: Yes. Go ahead.

Me: What will be my position?

I: A full stack developer.

Me: What technologies do you use in your project?

I: We use all the latest tech.

Me: Like?

I: All latest tech.

Me: You mentioned big data processing?

I: Yes. Processing data from DB and generating reports.

Me: what do you use for that?

I: Java.

Me: Are you planning to rebuild it using Spark or something and deploy in the cloud?

I: No we're not rebuilding it. Just some additions to the existing.

Me: Then what's with cloud? Why did you ask for that?

I: Just to know if you're familiar.

Me: So I'll be working with Java. Okay. What do you use for UI?

I: Flash

Me: 🙄

I sat for a couple of minutes contemplating life.

I: Are you willing to join?

Me: No. Not at all. Thankyou for the offer.

Thanks, I am happy to be sharing my payment details with your company.

ATTACHED TO THE LOGIN DETAILS YOU EMAILED ME!

I grew up poor. First time I saw a computer face to face was when I was 11 years old. Back then any other references to computers came through media. I genuinely believed that hacking was as seen on TV, didn't even question 2 idiots 1 keyboard and thought it was genius to unplug a computer during "an attack"

Fact is I arrived in this country when I was 11. By the time I had my first laptop I was around 13-14, as you can imagine it went really poorly for someone who was just awarded a machine of never-ending stories and entertainment with absolute fear that a single mistake can cause everything to crash and burn. Heck, I remember when I went to Vodafone and someone recommended Firefox, it was such a novelty back then, heh.

I didn't understand computers. My IT lessons were replaced to work on my dialect, but truth be told it was an awful waste of time. I've learned more from forums than I ever learned from any English teacher. I just sat there twidling my thumbs in agitation.

With no concept of what IT industry entitles (my idea of programming was cubicles and call centres), I never had a slightest clue programming could be for me. I always thought of myself closer to engineering or physics type, but that never really drew my interests. So I dwelled in depression thinking I'm broken. Useless. That there was no calling for me.

I'm 22. For the past year I dipped in and out of programming, it still felt like such black magic.vLast month or so the spell dispelled and I finally feel like my eyes have been opened. I've spent the past 3 days sitting in front of my computer learning or actively programming, with occasional dips into DevRant reading your stories, frustrations and victories and I truly feel at home.

In retrospect I feel like I made the right decision for not chasing any mathematical/physics/engineering degrees, while certainly a goal of mine, I feel like I'd be miserable in those communities. They're closer to hobbies, really.

I guess what I wanted to say is thank you. Thank you DevRant for being the spark in my null future and giving me a sense of purpose and belonging. For the first time I feel like I can make it, like there was hope somewhere over the horizon.

Made myself a little sparker :3 judging from the spark gap, the output is about 6-7kV I guess. Can't measure it though, it's way too high for my multimeters to handle. Taser, beefed up bugzapper module, electronic cigarette lighter, so many possible uses for this thing 😋

I have this little hobby project going on for a while now, and I thought it's worth sharing. Now at first blush this might seem like just another screenshot with neofetch.. but this thing has quite the story to tell. This laptop is no less than 17 years old.

So, a Compaq nx7010, a business laptop from 2004. It has had plenty of software and hardware mods alike. Let's start with the software.

It's running run-off-the-mill Debian 9, with a custom kernel. The reason why it's running that version of Debian is because of bugs in the network driver (ipw2200) in Debian 10, causing it to disconnect after a day or so. Less of an issue in Debian 9, and seemingly fixed by upgrading the kernel to a custom one. And the kernel is actually one of the things where you can save heaps of space when you do it yourself. The kernel package itself is 8.4MB for this one. The headers are 7.4MB. The stock kernels on the other hand (4.19 at downstream revisions 9, 10 and 13) took up a whole GB of space combined. That is how much I've been able to remove, even from headless systems. The stock kernels are incredibly bloated for what they are.

Other than that, most of the data storage is done through NFS over WiFi, which is actually faster than what is inside this laptop (a CF card which I will get to later).

Now let's talk hardware. And at age 17, you can imagine that it has seen quite a bit of maintenance there. The easiest mod is probably the flash mod. These old laptops use IDE for storage rather than SATA. Now the nice thing about IDE is that it actually lives on to this very day, in CF cards. The pinout is exactly the same. So you can use passive IDE-CF adapters and plug in a CF card. Easy!

The next thing I want to talk about is the battery. And um.. why that one is a bad idea to mod. Finding replacements for such old hardware.. good luck with that. So your other option is something called recelling, where you disassemble the battery and, well, replace the cells. The problem is that those battery packs are built like tanks and the disassembly will likely result in a broken battery housing (which you'll still need). Also the controllers inside those battery packs are either too smart or too stupid to play nicely with new cells. On that laptop at least, the new cells still had a perceived capacity of the old ones, while obviously the voltage on the cells themselves didn't change at all. The laptop thought the batteries were done for, despite still being chock full of juice. Then I tried to recalibrate them in the BIOS and fried the battery controller. Do not try to recell the battery, unless you have a spare already. The controllers and battery housings are complete and utter dogshit.

Next up is the display backlight. Originally this laptop used to use a CCFL backlight, which is a tiny tube that is driven at around 2000 volts. To its controller go either 7, 6, 4 or 3 wires, which are all related and I will get to. Signs of it dying are redshift, and eventually it going out until you close the lid and open it up again. The reason for it is that the voltage required to keep that CCFL "excited" rises over time, beyond what the controller can do.

So, 7-pin configuration is 2x VCC (12V), 2x enable (on or off), 1x adjust (analog brightness), and 2x ground. 6-pin gets rid of 1 enable line. Those are the configurations you'll find in CCFL. Then came LED lighting which required much less power to run. So the 4-pin configuration gets rid of a VCC and a ground line. And finally you have the 3-pin configuration which gets rid of the adjust line, and you can just short it to the enable line.

There are some other mods but I'm running out of characters. Why am I telling you all this? The reason is that this laptop doesn't feel any different to use than the ThinkPad x220 and IdeaPad Y700 I have on my desk (with 6c12t, 32G of RAM, ~1TB of SSDs and 2TB HDDs). A hefty setup compared to a very dated one, yet they feel the same. It can do web browsing, I can chat on Telegram with it, and I can do programming on it. So, if you're looking for a hobby project, maybe some kind of restrictions on your hardware to spark that creativity that makes code better, I can highly recommend it. I think I'm almost done with this project, and it was heaps of fun :D

I used to work as an all-in-one IT guy in a company. One day I got a call from our HR team and the HR said "my Internet banking account has been hacked! It's logging in automatically!!" So I went to see the issue, and the so called "hack" was because she allowed Mozilla Firefox to save her login credentials, and because of that the login form was automatically filled. Such a stupid ass

Some companies be like-

.. In job posting - We are the next big thing. We are going to change the industry. We are like Google / Facebook etc...

..in Introduction - We are the next big thing. We are going to change the industry. We are like Google / Facebook etc...

.. in Interviews - We are the next big thing. We are already changing the industry. Think of us like Google / Facebook etc...

.. during Interviews - Our interview process is rigorous because we are the next big thing. We are going to change the industry. We are like Google / Facebook etc...

.. questions in interviews - Since we are Google / Facebook, please answer questions on Java, C/C++, JS, react, angular, data structure, html, css, C#, algorithms, rdbms, nosql, python, golang, pascal, shell, perl...
.. english, french, japanese, arabic, farsi, Sinhalese..
.. analytics, BigData, Hadoop, Spark,
.. HTTP(s), tcp, smpp, networking,.

..

..

..

.. starwars, dark-knight, scarface, someShitMovie..

You must be willing to work anytime. You must have 'no-excuses' attitude

.........................................

Now in Salary - Oh... well... yeah... see.... that actually depends on your previous package. Stocks will be given after 24 re-births. Joining bonus will be given once you lease your kidneys.

But hey, look... We got free food.

Well, SHOVE THAT FOOD UPTO YOUR ASS.

FUCK YOU...
FUCK YOUR 'COOL aka STUPID PIZZA BEER - CULTURE'.
FUCK YOUR 'FLAT- HIERARCHY'.
FUCK YOUR REVOLUTIONARY-PRODUCT.

FUCK YOU!

I try to explain my problems to my 6yo twins. It is just HILARIOUS to see their small faces going "huh. Did you tried using that spark thing to send your emails for you?".
Srsly, they give better advice than half the devs I work with. Rubber ducking be damned.

I know Australia has shit internet, but seriously?

WHAT THAT FUCK
I PLUGGED IN MY LAPTOP CHARGER TO THE WALL AND A HUGE SPARK APPEARED AND THE ENTIRE ELECTRICITY OF THE HOUSE FELL

The last 5 months have been tough.... My boss ( who was a close friend) quit and I become interim department head... Trying to run a team who didn't seem happy I'd taken the reigns.

At the same time my wife's ongoing battle with her anxiety had gotten worse and she really needed my help with everything possible at home..

In March I was confirmed as the HoD but I was still doing 3 to 4 days a week on client delivery, trying to support all presales activities, manage a team of 10 people, travel for work and support my family....😩

It really got to me and I was close to breaking... The worry of not replying to an email ASAP no matter what time of day would eat me up, working late every night... It got too much and I was running on fumes with my weekends just me completely wiped out and useless to the family. 😓

.....But.....

I had a escape last weekend to a 🍻 beer 🍻 festival with friends that I was considering not going too and just losing the money but the wife made me go...

And it broke me even more... So much that its somehow put the pieces back in the right order in my brain and snapped me out of my major rut!

Somehow, sitting with friends, making stupid jokes, drinking way too much and blocking out all the work crap gave my brain the hard reset it needed. 🤟

This week I've come back a different person ( wife's words) work is a breeze, exciting and encouraging.... 👊

I can't get enough of playing silly games with my kids all night

And couldn't feel any more positive about things if I tried.... Set that spark back for my wife too! 😏💏

So.... After that long rant 👀

Tl;Dr - work and life got too much... Close to giving up... Too much beer with good company gave me a hard reset and I feel like a new person.... 👍

Plus the team is now loving the new direction and strategy too 👔

Who says drinking is bad for you? 😂🍻

First of all, I hate crammers so much. These people kill the industry without even understanding it. They turned interviews into exams, missed the point of hiring, and saw no distinction between knowledge and information all the time. They don't understand that if you can google an answer in five seconds, it's not knowledge. It's information.

They don't understand that questions like 'what will Python do if you delete an item from a dict while iterating over it' are complete nonsense. They don't understand that it's not 'dig deep'; it's just a bad practice that leads to errors, thus must be avoided. The fact of remembering 'RuntimeError: dictionary changed size during iteration' means that you haven't been avoiding it enough.

One more example. Which signature is correct?
- ApplicationListener<ContextRefreshedEvent>
- ApplicationListener<ContextRefreshEvent>
- ApplicationListener<RefreshedEvent>
- ApplicationListener<RefreshEvent>

Second. What's the point of forcing you to write compilable code in google docs? Do they really expect that one could possibly remember 'import org.springframework.beans.factory.annotation.Autowired;'? Seriously?

Third. Why do they expect me to know Spark, Java, J2EE, Spring Boot, Python, Kafka, Postgres, React/Redux, TypeScript, and work for miserable 70K EUR?

What's wrong with the European IT job market? Are they fucking nuts?

So, for an assignment we have a task of developing an IT product for a business to solve one of their problems. One of the project development examples contains the following screenshot.
You can tell, from this screenshot that whoever made a screenshot of this example has no idea what they're doing.

South Africa Electricity:

This is after I lost my 7th 3000VA online UPS...

In South Africa we have 240V power most of the time which is great, but then there is scheduled power outages (because our electricity companies cannot "handle the load").

When we have a power outage we have automatic generators which brings everything back up although there is still the 1 minute drop which has weird spikes and odd voltages before switching to the generator (as the generators wait until they are stable)

This has being destroying our equipment, we had a $2000 repair bill 3 TIMES for 3 SEPERATE Xerox Machines that have surge protectors although their circuit board somehow fried.

We have lost 7 3000VA UPSes (3 different brands) and 5 voltage regulators we put to protect the UPSes.

The one UPS that fried just had 2 dead fuses, I decided to replace them (unplugged the batteries to avoid 240V) and when plugging the batteries back in there was a huge spark and flame and the metal and plastic melted onto the board and turned black (the metal pins to connect the battery are non existant now)

I am done with electricity...

P.S. 2 of our generators also got hit by lightning as we are high on a hill and ALL the plastic cable coverings inside the generator were melted

!dev !sex I promise this is a good read

I once read the whole bible.

Not in one sitting, ofc. I read it in a period of a year, just 3-4 chapters a day.

Is it something to boast about?
I'm not sure.

I mean, I guess being able to read through it despite not being exactly entertainment material (except some fun parts) kinda is. So I might feel a tad bit proud about that.

But I'm actually more happy that I did instead.

The reason I'm more happy than proud is because I took awareness of the religion I was in.

I became christian when I was an early teen. I grew up in an agnostic family. My dad was kinda hippie and my mom was into leftist ideas.

So me becoming a christian was a bit orthogonal to their philosophies.

I started assisting a church because I was very alone and misunderstood, and found some people there that seemed to get me, and viceversa.

But as time went on and I got more exposed to christian doctrine, my level of commitment grew.

I wanted to save people from going to hell. It sounds funny, maybe egotistical, but it's true.

3, 4 years of being in the church go by. I collaborate in the church, I make some very personal friendships, I was very deep in church by that point.

I then decide that I should take it to the next level and read the bible. So I did. And unknowingly, it started this feeling in me that I didn't liked being a christian at all.

I'm not gonna deny there are some christian values that are still compatible with today's modern society, such as being a good samaritan, working hard, being honest.

But there were too many verses in both old and new testament that I found morally repugnant,

The ones that made me feel the worst about christianity, though, were the ones that condemned homosexuality with death.

Since my dad was a hippie, he used to be in artsy things, like theater or music, and through that he had some gay friends

And for real, I think they were the nicest and most cheerful people I'd met as a kid. So I could not be part of that anymore.

Let me clarify that I didn't stop being a christian immediately after finishing the bible, but it did start a spark "of "what tf do I even believe in...?"

That spark turned into flame when I started the university, a place where people think for a living.

It's no wonder my mind started completing the puzzle, and slowly I started liking church and christianity less and less.

Until one sunday I didn't want to go, and I didn't, and from then on, I pretty much severed ties with that church and christianity.

Which is crazy considering I went every sunday without interruption for 6 years, and several saturdays too.

Anyhow, that's my story of me getting in n out of christianity. Like in the previous post, it sure how to end this, so go fuck a rock or something.

One of the biggest reality checks you will run into when starting your first dev related job - and which they don't teach you about in school - is that a lot of the time will be spent working with other people's code, and rewriting it into "your own" is rarely an option.

You might be super into making things, but not everyone manages to maintain that same spark while taking over a 15 year old project with fundamental issues that have to be triaged "for now" because you need a hotfix on this other specific thing out in prod before lunch.

There are no gods now. They left the company years ago and nobody knows why they used the windows registry as a user repo.

*Fun with Javascript
`Math.ceil(1.0000000000000001) // output = 1`
`Math.ceil(1.000000000000001) // output = 2`

I hope it'll lit a spark in your mind.

My colleague unknowingly uses the word "paralyze" for "parallelize". When is the good time to correctly him? So far he has successfully paralyzed my code.

Do coding outside of work. I got into the industry because I enjoy writing code, but your job won't always be fun. That's why they give you money. Make sure that spark of joy doesn't die.

Or, when it does die, at least you'll have something to rant about.

There was this 'Hadoop' trend going on. So I thought that i'll start Hadoop. After one month people have started to trend Spark claiming that it is faster. -.-
And now I am outdated.

some inspiration to ignite your inner spark.

#Amazon release notes #killer note

I have this amazing idea, said John
I ask John about this amazing idea.

John goes on to say that it will change the world and solve world hunger.

I ask him again, what's your idea?
John says my idea is to 'solve world hunger'! AMAZING RIGHT?

now now John, so you're gonna do it like (provide a few solutions)..
John says yeah that was exactly what my idea was (ah. Fuck you)

So John now is under the delusion that he can solve world hunger and the steps to do it came from his own ostrich-brained imagination...

Tiny fuck doesn't even realize the fact that he plagiarized.

Now we look into the future where I ask John honestly that he should come up with his own idea to solve world hunger and not use mine.

JOHN GETS ANGRY
John asks 'do you actually think that was your idea? We were brainstorming man, I told you we had to solve world hunger and only because of my voice did I spark that idea in you, I created that idea man'

So, well since he's plagiarized so much I told him that I had this plan to perform a hunger strike in the grand Canyon to get some attention..

Fidgety little bitch found another idea to steal and he was like good idea!! I'm booking my flight to the Grand Canyon now!

What bout me I ask? He says man take some rest let me face the pressure (and the glory apparently)

Well, John did not return.
Poor stupid John did not realize that I had been joking and got his little ass fired under the direct sun in the grand canyon

Moral of the story :
I WILL DESTROY YOUR HOMES AND YOUR LIVES PLAGIARISTS, I WILL EXTERMINATE YOU *cough**cough*
Damn that Sulphur hexafluoride actually worked!

!dev !rant

Update on my health: I am completely fine, just like @SoldierOfCode! We are making sure to listen to the news and go to the shelter when there’s sirens.

Please don’t get political in the comments, I don’t want to spark a shitstorm in this post.

At an expensive Apache Spark training class. For hands on portion you use their system. When everyone logged on, their system couldn't handle the load. First they blamed the hotel wifi (even though every other site was running perfectly) and then they blamed AWS. It's clearly an issue with their system. It's ridiculous to not be honest with a room full of developers who know what's up.

Fun day, lots of relief and catharsis!

Client I was wanting to fire has apparently decided that the long term support contract I knew was bullshit from go will instead be handled by IBM India and it's my job to train them in the "application." Having worked with this team (the majority of whom have been out of university for less than a year), I can say categorically that the best of them can barely manage to copy and paste jQuery examples from SO, so best of fucking luck.

I said, "great!," since I'd been planning on quitting anyways. I even handed them an SOW stating I would train them for 2 days on the application's design and structure, and included a rider they dutifully signed that stated, "design and structure will cover what is needed to maintain the application long term in terms of its basic routing, layout and any 'pages' that we have written for this application. The client acknowledges that 3rd party (non-[us]) documentation is available for the technologies used, but not written by [us], effective support of those platforms will devolve to their respective vendors on expiry of the current support contract."

Contract in hand, and client being too dumb to realize that their severing of the maintenance agreement voids their support contract, I can safely share what's not contractually covered:

- ReactiveX
- Stream based programming
- Angular 9
- Any of the APIs
- Dotnet core
- Purescript
- Kafka
- Spark
- Scala
- Redis
- K8s
- Postgres
- Mongo
- RabbitMQ
- Cassandra
- Cake
- pretty much anything not in a commit

I'm a little giddy just thinking about the massive world of hurt they've created for themselves. Couldn't have happened to nicer assholes.

So there is this programming competition i regularly enter. I dont give a shit about the competition part, its just fun to make something in a limited time. This year, i was kinda hyped that i threw together a modern stack, with Java Spark and VueJS, that would be really cool to use.

Today we got the requirements.

Php and jquery.

Well fuck me for living in 2017 apparently.

Four engineers and a broke down car

One day, mechanical engineer, electrical engineer, chemical engineer, and computer engineer were driving down the street in the same car when it broke down.

The mechanical engineer said, “I think a rod broke”.

The chemical engineer said, “The way it sputtered at the end, I think it's not getting enough gas”.

The electrical engineer said, “I think there was a spark and something's wrong with the electrical system”.

All three turned to the computer engineer and said, “What do you think?”

To which, the computer engineer replied, “I think we should all get out and then get back in”.

In my unenlightened youth, when programming was a module in my college diploma that didn't seem to be taking me where I wanted to go, I had a couple of guys guy in my class that could arguably be the weird ones.

Jonny, although he asserted that he was to be called "Jonhty", whatever, we never did. He was pretty much top of the high school food chain and for some reason elected to study computer science, none of us was prepared to put up with his shit. He was always boasting about some fanciful claim or another, famously entering the classroom and exclaiming he'd "fucked an absolute milf" and seemed somewhat evasive about the answer, turns out he was 17 and she was 35, the age difference was greater than his own age. We burst out laughing. He would also turn up late and state the college bus was late (it wasn't I got the free bus every day, he'd just not got out his wanking chariot early enough).

One valentine's day we got him a card from a mysterious stranger which was accompanied by a package containing a cucumber and Vaseline, the inside of the card read "to assist you in the following request: please go fuck yourself".

Before you think we were being unduly harsh, we had a centre table where we'd be taught from with computers around the outer rim of the room. He'd come up behind people while at the centre desk, quietly press ctrl+P and slowly walk back to the printer. I saw him do it to my machine and I got to the printer first, to which he shouted "that's MY work" which was amusing because unbeknownst to him I had put headers on all my documents so he really didn't have an answer for why my name was at the top of every page.

To top it all off he had dead eyes, there didn't appear to be much going on but the rent, there was no spark of intelligent life, and while I thought it, I never said it out loud, but other students did and I had to agree. He was just copying his way to graduation. However, he ultimately didn't graduate when people refused to allow him to copy.

Another guy, Richard I believe his name was, which is just as well because he was a right dick. In the UK our word for white trash is "chav" (that's a very naïve explanation for it but that's another rant best left for "socialsciencerant") and he was an complete idiot who was gifted with more brain cells than he ever needed to use. He actually studied hard and got reasonable grades, probably on par with me, but he boasted about smoking weed all the time, he was forever playing dark side of the moon via his loud mp3 player. I kinda left him alone generally until he was high in class one time and while we we're watching a documentary he'd shake my chair and make a weird noise in my ear every few minutes, the first couple of times startled me, the remaining multi-dozen times pissed me off.

It all came to a head with this guy when I'd been hearing about his uninteresting bs on drugs, music and how best to spend my time ("you need to lighten up man, come round my house, take a joint and relax man", that sorta thing), well this guy walked like he was mid way through shitting himself so I personally think that perhaps he is too chilled. Anyway he's arguing with me and after the exchange of him making his point, me disagreeing and expecting the end of it, he made the mistake of saying two words to me:

"Listen, mate..."

And I had him in check mate.

"Listen, I ain't your fucking mate , I don't even like you, you're a disruptive annoying twat that thinks he knows it all, we're all 17, none of us know anything, so shut the fuck up, sit the fuck down and stop boring me with your drugs, I ain't interested, and for the record I think pink Floyd ruined prog rock!"

He looked at me with sad puppy dog eyes, and started with the "but, why?", However I was interrupted and had to leave the class for unrelated reasons, I returned to be told he'd put safety pins up right on my chair so I'd sit on them, and mutual friends who TD me I'd been cruel and that he doesn't was hurt, so I should apologize, he overheard and said he was sorry for bring a bit of a dick.

However, you just know when you don't get on with someone? Yeah, that. So I said I wasn't sorry for what I said, for while it was harsh, I am not his mate, nor did I want to be his mate and that was all I had to say on the subject, and that if he wants to take offensive to a nobody not liking him then he's in for a very rough time in life.

Unsurprisingly I don't keep in touch with anyone from college!

On a date

... as a strategy to intimidate and show myself as a hacker. It did work and spark interest ❤️

A morbid realization (I am just wasting your time keep scrolling)

Unless someone takes a stand for the user, and their comfort and requirements, unless someone looks a client straight in the eye and says "no, I will not do that, and neither will my team" and denies them their request, nothing will change, good devs will keep losing their spark to save themselves frustration, good people will walk away and the tyranny that we face daily grows... unless someone stands up, someone who cannot be knocked down, or reprimanded and told they're wrong for fighting for what's right.. unless someone stands up for what is right and fair... nothing changes... and nothing ever will... poor programs, bad games and content, lower standards, frustrated users, annoyance that you don't matter as a user or a dev will never go away... unless someone says enough. But no one will, money is the boss, morality a liability, and people an abundant resource. This world is backwards, devs are carrying the blame and no one who is able, cares enough to say "that's enough!".

REDIS: Great for cloud, will fuck up your local disk if too many write operations per second.

DynamoDB: WTF 10Mb should not be "too large for a single record"!!

SPARK: NEVER CONNECT IT TO A DATABASE! Wasted A LOT of cluster time. Also, can you be LESS specific on exactly what are the bugs in my code? 'cause I don't think it's possible.

NPM: can't install a package for shit. tried it waaaay to many times.

Makefiles: Just fuck you.

WSL1: breaks more often than a glass hammer.

Python >= 3.6: FUCK ENCODINGS!!

Jupyter: STOP MESSING UP WHILE SAVING!

Living is to collet bugs, it seems.

This day I have received the most glorious news in e-pistolary form. For some years, I was suffering in support of a client who was, well, insufferable. My presence there paralleled the divine comedy in both essence and fact.

I opened the missive, expecting another plea to bail them out of whatever clusterfuck they found themselves in. Instead, what I found was something truly magical.

"Hey Human,

I hope this finds you well. I'm not sure if you remember a few years back, we were trying to decide between IBM Cloud and AWS. Well, after years of battling FF*, we're finally moving ahead with AWS. He failed one too many times to deliver anything visibly. After you left, there was no one left he could use to steal credit, ideas, and work.

FF is still pushing to have them use IBM cloud as a "warm backup" in the event "AWS fails." We will see where that goes.

I figured you'd like to know; you were the void in the wilderness for a long time. I don't want to think about how much time we could have saved if we had just listened.

PeeEm**"

This event represents a personal victory, albeit belated, over a few peoples' absurd amount of privilege. Towards the end, I was vicious about my contestation to the insanity of adopting a desperate hedge attempt-as-cloud offering from a failing company. Some examples:

// cloud 'strategy meeting'
Moi: What cloud platform are we looking at using?
FF: We're looking at IBM cloud and AWS as a second.
Moi: Why is that? I understand you're obligated to rep your offering first, but that decision doesn't seem to have the customer's best interest at heart.
FF: IBM cloud is a market leader; AWS isn't as good.
Moi: I see. I mean, that's the tech equivalent of the company's fleet management considering monkeys on tricycles as a strong competitor to service trucks, but I get what you mean.

// steering meeting
Director: Who can we look to as an example? Who is currently using the IBM cloud?
Moi: No one; they account for a single-digit portion of the actual cloud market. Their long game to sell you a "Hybrid Cloud," which means put some front end payload in a CDN, and buy n-frame units of IBM z servers for the DC with IBM gateway appliances acting as connective tissue. So it's not the cloud at all, really.
Director: How does it compare in cost?
Moi: It's generally 40% more expensive than other clouds, and it only goes higher as you option their software.
Director: What about Watson? I hear Watson is good?
Moi: It's a brand name. Most of the "Watson" product is just a facade on top of FOSS products like Spark, Hadoop, Elasticsearch, etc.
Director: Those were words. They sounded good. FF say it's good tho so we'll believe him because we're from the same city.
Moi: *deletes Director from LinkedIn*

Moral of the story: Never trust a vendor that only recommends their products.

*FF = FatFuck - an embarrassingly rotund individual whose girth is roughly equivalent to his height. He shit his way into an IBM architect position in his mid-20s purely due to winning the visa lottery. He had fake hair glued to his head for his wedding to hide his male pattern baldness; his arrange-married wife undoubtedly cries herself to sleep after sex.

**PeeEm - the then project manager, now portfolio manager of some satellite projects. An overall decent human being, capable.

Fucking shit uni is such a waste of time. We are learning Apache Spark in Big Data module. Fucking losers have Spark 1.6.0 installed while the latest version is 2.2.1 right now.

What a bunch of cunts. We are paying tons of money to study deprecated shits and a degree. A fucking degree that is not even on a piece of paper anymore.

Fuck this shit man.

My manager's boss just commited on a delivery date a month from now. We dont know what is to be delivered, nor does the client. We are supposed to work on a platform that we know nothing about. And of course the catchphrase is : yeah just use big data and spark. I'm dying...

Luck, grinding leetcode and using the hottest buzzwords in your resume to spark recruiters. Or having Yale in your resume in spite of your major being deer fecal biology and a minor in chemical analysis of deer semen (with doctoral experience in manual extraction of semenical fluid from bucks during rutting season...and no it doesn’t count as beastiality bc it’s science and it’s an Ivy League study so it’s a-ok)

Is it real?

Achievement get.

Downloading Visual Studio at Microsoft.

Well it was that moment when I realized how all that shit fits together. So it was that sunny day during summer holiday. Me and I was learning some c++ and I'm like "why the fuck am I doing this. I should be playing with friends". But I was too lazy for shit and you know :)

So it was the second empty can of coffee that day and I was making me a new one while there appeared this little spark in my brain. And I'm like "wait.... I think I just understood how the world is working".

I was so fascinated btw that I spent the whole holidays doing c/++

1989 - Does it spark joy? :D

I struggled to find the interview location as the company as they were using another companies offices. As I sit down, sweating, feeling rushed for barely making it on time the interviewer says: "Tell us a joke"

I should have got up and walked out, but since I was there already I pulled this one out:

One day, a mechanical engineer, electrical engineer, chemical engineer, and computer engineer were driving down the street in the same car when it broke down.

The mechanical engineer said, I think a rod broke.

The chemical engineer said, The way it sputtered at the end, I think it's not getting enough gas.

The electrical engineer said, I think there was a spark and something's wrong with the electrical system.

All three turned to the computer engineer and asked, What do you think?

The computer engineer said, I think we should all get out and then get back in.

To be honest, I'm not as excited as I was 6-7 years ago when our tech industry seen a big leap, where these ML/Deep Learning algorithms were out performing humans, Apache Spark out perfomed Hadoop in distributed computing, Docker/Kubernetes are the new phenomenon in software development and delivery, Microservices architecture, ReactJS virtual DOM concepts were so cool.

Really though, I've come realise that these software trends come and go. All you need to do is adapt and go with the flow.

Just finished dumping all ethereum tranasctions into one big 30 GB csv.

Only thing left is to configure Apache Spark cluster.

A report from The Register :

ICANN has halted the proposed $1.1 billion sale of the .org registry to a private equity firm. The DNS overseer has been under growing pressure to use its authority to refuse the planned transfer of the top-level domain from the Internet Society to Ethos Capital. "ICANN ultimately bowed to the US state's top lawyer when it concluded today it "finds the public interest is better served in withholding consent."

The decision will likely spark a mixture of relief and celebration from millions of .org domain holders, including some of the world's largest non-profit organizations, many of which were certain that their long-standing online addresses were going to be milked for profit by an organization that never fully revealed who its directors or investors were.

I started noticing something about startups here. They all think they r innovative and full of fresh ideas, but they all just copy bigger companies. My old coworker started a small web dev company and they are using php with react, the company ladder is the fucking same as anywhere else.

I noticed these as i was collecting ideas for a company (if i write that word again pls shoot me). So far we are thinking
0) no, or minimal local storage, we would have a github subscription, jira cloud, vps
1) no strict hierarchy, ultimately the ceos would make the decisions but in every meeting we would include even the interns
2) the stack would not be set in stone, java spark and vuejs are good starting points but frameworks exist to serve a purpose
3) like 2-3 days office time per week, if someone wants to work from a café, why not

This app seems to be mostly web developers so I have a question that will either spark interesting discussion or a blood curdling flame war. Either way:

I'm trying to build a blog site for myself. I'm not a web developer, for the most part I write C software, but I have written web software before. I want to write it, not use a CMS. What are some techniques and tools I should be aware of, so I don't break my keyboard in frustration?

I've tried so many ways for that at night or during walk spark of bug solving ideas:

- fluorescent ink on regular paper
- florescent mini whiteboards
- "alexa remind me.."
- writing down in my phone
- recording on my phone
-..

But all of those due to my short term memory made me forget half the things by the time I opened the fucking phone/app, found where to grab the pen or the whole dance for alexa, to remember the exact phrase I have to spell out, when it should remind me, what time,..

Earlier today I remembered how I had a little tape voice recorder I used to use a ton, thankfully that tech advanced by now and found myself a stereo mic setup little voice recorder that can also act as an mp3 player!

Went for a walk today, while listening to some podcasts, then it hit me as usual on how to fix and implement some things that were awkward at best on paper when I left home, pressed the record button, recorded it and went straight back to music mode, which remembered where I left off!

I'm so indescribably happy, I ordered quite a bunch of the same to just throw around everywhere, at the bed, in the bathroom, kitchen, for walking outside, everywhere haha

Goodbye Inbox 😢

Hello Spark!

Apparently enterprises have some stitching problems with technology stack.

Looks like my new years resolution is to be more controversial.

I realize that all the OSes can easily have 10s with the correct setup, however that wouldn't be much fun.

Bit of background:

After I almost threw a Windows pc against the wall for not being able to ssh from the cmd after I had already spent ages trying to install something, which was one command on the Linux and Mac terminal, I thought about the differences between the 3. Then, when a friend of mine (who has used Linux for many years) spent many hours trying to connect a pair of headphones to his Linux computer, I decided to make this graph to spark a debate and hear your opinions.

Best backpack for a Dev?

0 and null

Multi-continent low-latency auto-scaling eventually-consistent kubernetes-orchestrated and spark-powered multi-cloud data-plarform.

(Note to self: why do jargon words always come in twos?)

But seriously, the engine ELT's naval and logistical data from every continent and ocean and feeds a global analytics platform for less then 0.25 USD per ingested Gb across all systems.
And sometimes the PODs are even onboard en-route ships! Edge computing, y'all!

Tech project I'm most proud of.

Has to be writing.

Not exactly a better dev, per se, but close enough.

I used to read books and imagine all sorts of possible scenarios to different events. One day, after replaying the Mass Effect series, I began to think about alternate ways to end it. Opened Libre Office and started hammering away. 10 minutes later, I had an outline. Never actually finished that story, but the spark was there.

I began noting down outlines and creating structures for interesting games and books; that soon carried over to my work. Before and after every meeting with my boss, I'd have outlined how the meeting was going to go, and how it actually went. Gave me a sense of order.

This in turn helped me be a better manager (I work with a team of 9), and I tell you guys, it couldn't have come at a better time. I had been promoted quite suddenly, and had been fucking up quite a bit at the start.
I had my shit in order. My team was happier and more efficient. My boss was happy. I was given bigger goals and tighter deadlines. I fucking loved it.

All this, from writing some fanfiction. (there, I said it!)

P. S: I stared at this for a solid minute, still not sure how it all came together.

My client is saying that MS excel is so powerful that we don't need spark to process data. 🤦‍♂️

How hard can it be to make a calculator app. Apparently Microsoft cannot get it right. You might say hey, but it works already. No it does not. See in math 1-(-1)=2 because the double minus sign cancel each other and turn into a plus. Well the w10 calculator app, just does 1-1=0 and show that this is the result. Yes this is the result of one minus one. This is not the result of one minus minus one. This is basic math .... Stop focusing on the interface and code the base right Microsoft.

Don't you hate it when you buy an expensive "gaming" keyboard and the device crash during use ? Mine does that also it lock up the mouse too.

After 3 years of postponed delivery dates and enduring a crappy internet connection the result is close enough to touch. 1 Week until I get a solid internet connection and can join the rest of modern society.

100Mbps internet here I come!

More updates to come with undoubtably more frustration!

First day in school after the holidays today. But I've got a bad feeling.
So basically I've been coding till 3am this night. I became tired and shut down my PC. I then pulled out my USB when suddenly a spark was coming out of the USB port. I had a really bad feeling about that. All of a sudden my PC started booting. The fans started spinning and the GPUs LED lit up. Then it was all off again. Aaand it turned on, and off, and on..... I just pulled the plug and went to bed.

Now I'm sitting in school and can't think about anything else but what could have happened to my PC :(

funny how creating something merely useless like a text2asciiart converter can spark this amount of joy

When you are new to a technology and language, but have to make full use of its feature.
You know, make tests, implement production code, planning deployment, build a CI. All by myself.
No regrets, though. Challenge accepted!

We had a tutorial on how to use spark/Hadoop.. part of the tutorial was the installation instructions for Ubuntu vms.

The Prof insisted we used an older version of Hadoop (v2.1.5), so naturally this required pulling older repos and older versions of java.

Naturally, some of the people in the class got some namespacing issues and garbage left from uninstalled packages.

Now, the tutorial was geared towards business/math people, not com sci. So most of the people didn't understand why apt didn't let them run certain commands (even though it very clearly just asked for them to run autoremove or autoclean, like in the "error message"). When the Prof and their "experienced TA" saw these messages, their recommendation was "make a new fresh vm".

The fuck? I heard that, run over and was like no. Just run the suggested command, it's literally a simple issue. And the guy didn't believe me. I had to sit him down, show him how I literally typed what the console was asking for, and everything just worked... The guy's response was "well that's Linux for you, its really complicated and can never trust anything, this time it worked, but next time it might not". Dude... Do you even know what you are saying? Like you are a supposed expert, least have some understanding of the package manager you are using. Maybe things will then be less "schrodinger cat".

God damn I can't wait to be out of this stupid fucking school. Never going back to academia.

Did you guys notice that the new Chrome update removes the www from domains along with the https.

bitter reflections from a bitter dev on hacktoberfest this year (in the past 2 hours of trying to find issues my IQ has at least halved):

- DefinitelyTyped - used to be my bread and butter to complete hacktoberfest; now, not sure if actual issue, or person just doesn't know how to use typescript (found a multiple such issues that were actually non-issues, the type they were asking for was right there, no pull request needed)

- avoid "issues" on no code / low code tools, these are toxic issues with titles like "I EXPLAIN BUG HERE", then probably not even a bug / more a feature request or clueless clown

- if your entire contributor team has the same character styled profile pic + background, i can't take you seriously; if your identity is so closely tied with what github team you are on... uh, i mean cmon what is this kindergarten? (also love the fact that an anon managed to get themselves mixed in hahahaha they ruined it perfectly!)

- most 'hacktoberfest' issue finders themselves are broken or don't load anything

- people claim issues and then never return YAWN

- the hacktoberfest discord: the projects channel is mostly people promoting their garbage repo WHICH HAS 0 OPEN ISSUES IN THE FIRST PLACE AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA and then OTHER people promoting their own portfolio on hacktoberfest???!! 😂😂😂😂 yeah bro i'm gonna help you with your own portfolio site GTFO

from what i've seen, i think i can start working approximately 5 minutes a day and be more successful than these absolute 🎪🤡🤹‍♂️ devs

sure, there is being a beginner, and there is being a clown salesmen trying to get people to do work for you... i mean wtf is going on

i WANT to help and contribute, but this year its really a struggle to find anything worthwhile to contribute to!

somehow the spark is gone... this might be my last Hacktoberfest... let me just return to my wisky and be in peace

Kinda annoyed at NDA's right now

Can't discuss what I'm working on with old classmates for another opinion. And my co-workers are self-taught on this job as they needed so everything I'm doing seems like magic to them

So they're probably not going to spark that inspiration I need right now

And I can't reach out to the R&D department full of programers with this cause they're heavily behind so we're told no distracting them

I'm not sure if it is a dev experience, but definitely boosted my morale.

In 2014, my company (in India) sent me to attend a conference in Boston. The conference was about big data.

When I came back, I wrote a blog post about Apache Spark in my company's blog. Because of the blog, my name got mentioned in a prominent newspaper's article about Apache Spark.

PS: That is my only blog post till date

Today start with new programming language scala. All seems to be new.
Little bit same as java.

My left cortex: You have a paper to write @poster983. Put devrant down.

My right cortex: NO! Enjoy yourself. You have a study hall tomorrow. Do it then.

My left cortex: Remember, you already said that about history. Best to do it now!

*mouth makes farting noise*

My Right cortex: COME ON! IT'S HUCKLEBERRY FINN. JUST USE SPARK NOTES! DO IT L A T E R!

My left cortex: fuck you right.

My right cortex: right back at you.

*Snapchat buzzes*
My full brain: OK HALT THE DEVRANTS! THE BOYFRIEND IS TEXTING!

(Notice the recursion here?). This is why I can't ever write papers.
Same thing applies to when I'm programing. I end up spending 2 hours on something that only should have taken me 1.

My left cortex: Stop Ranting!

Help me.
💩

🔥👽🤘🏻
I've been CRUSHING it lately, so stoked!!!
**Also, this means that in the near future something will crush me because I have a few subjects on deck I need to lock down.

1. Deno

2. TypeScript(deep dive)

3. CPP (currently 75% done with my 2nd masterclass, first one complete)

4. Multi-platform local device storage (Sqflite/mongoDB/shared preferences/Hive)

5. REST/api/requests/json management && application

6. Implementing Firebase authentication using Apple, Twitter, and mobile OTP

7. Cloud functions && server scripting/automation

8. Intro to embedded systems/OS/kernels

9. Steadily improve my code style, design strategies, and build patterns that are team friendly && provide easier code base maintainibilty

10. Influence, teach, and/or spark the interest of someone new to development in any possible- all that matters is getting new people on board, making sure they are stoked about, and last but not least making sure they feel welcome in the community and are able to start off in the right direction.

cheers, ya fockers!!!!

Back in 2005 while I was in grade 5.. I was given a computer assignment for MS Word. While opening word, I stumbled upon FrontPage, which was the first spark in my web Dev interest. That was the beginning, it was only 4 years later that simple web design was part of my computers class. That is where things really started. I began coding small websites. And in 2012, my school requested I make a small website for a school event. I did so using a free template xD

I started perfecting my skill in 2013 and have been learning different languages ever since. Got my first clients in the same year too, 2013.

MaterialUI? Is it shit?

A brand new code base. Old codebase (old employees) used MaterialUI, locking in a lot of the styling and layout in their grids.

I'm trying to identify the pros/cons that can come from experience using the framework.

Some questions to spark discussion:

Anyone used this in production for a period of time?

Did it hold up? Did the designers hate it?

How was mixing this with SASS etc.

Cheers

Right now im probably the only person using a {java spark, python, mysql, webassembly} stack and i dont know how to feel about this

Else Heart.Break() has anyone else played this if not. Strap on your modifiers and pick you up a copy because this game is full of spark.

Joined a new company and the first few weeks were a complete bore (didn't have access to anything). Ended up wasting time instead of using it elsewhere. Now that I am swamped with work I've the sudden spark to learn every skill I thought I should pick up. Does this happen to anyone else? Motivation comes only on busy days.

Given how much talk there's around security, I think it'd be grand idea to dedicate a weekly rant to cybersecurity. Could spark an interesting discussion, especially in today's heated climate. Thoughts?

E.g. Best way to increase security/privacy?

Why all email clients on Mac have light colors 😠?

I really wish spark had a dark theme :(

Disclaimer: This is all theoretical. Neither me nor my friend (with whom I discussed this) are stupid enough to even try to pursue this, but as an idea, i believe it might generate cool/new ideas/ways for handling secure communications across social groups.

Let's do some role play. Let's design a delivery app for drug dealers, think Seamless or Uber Eats, but for drugs. Not for big deliveries, like kilograms of coke, but smaller stuff. Maybe a few grams of it or something. The clients could rate dealers, and vide-versa. This would build a level of trust within the system. There would be no names, just anonymous reviews, ratings, and prices. Only the info you'd need to know.

The biggest (only?) problem we found (besides legality) was that, how would you prove that you're a client and not a snitch (or cop). This would have to somehow be handled both on signup, as well as when ordering (let's imagine that all who are clients are pure and won't ever snitch).

One of the ways we found to combat this was to have the app invite-only. This would, in theory, do away with the problem of having snitches signing up. However, what if the phone got stolen/breached by a snitch, and they also got full access to the account. One way we thought we could combat this would be with a "dispose number" or something similar. Basically, you call a number, or send a text, or message a Signal bot etc, which would lead to the account's instant termination, no traces of that user left. Hence, a dispose number.

The flow of the app would be as follows:
A client wants some amount of heroin. He opens the app, searches for a dealer, sends the him the desired amount, and in return gets back a price from the dealer. If both parties agree on the amount and price, the deal would start.

The app would then select a random time (taken from the client's selected timeframe and the dealer's "open" time) and a location (within a certain radius of both them, somewhere in between them both for convenience). If both of them accept the time and place, they'll have to meet up at said time and place.

The actual delivery could also be done using two dead drops - the client drops the money at one of them, the dealer drops the goods at the other one. Yes, this might be subject to abuse, but it wouldn't be that bad. I doubt that clients would make huge orders to unknown/badly rated dealers, as well as dealers accepting offers from badly rated clients. My idea is that they would start small, just so if they do lose their money/goods, the actual loss wouldn't be as big for them, but for the other party, having bad ratings would mean less clients willing to buy or dealers willing to sell.

A third way would be to use crypto, but the reason I left this as the last one is because it's not that wide-spread yet, at least not in local drug dealing. With this method, the client would initiate the order, the crypto would be sent to either the dealer or an escrow account, the dealer would then drop the goods at a random place and let the client know where to go to get them. After the client has gotten the goods, they could both review/rate the quality as well as the overall experience with that dealer, which would either make or break the dealer's upcoming deals. This would be pretty much like other DNM's, but on a local scale, making deliveries faster.

So far, this would seem like something that would work. Are there any ideas that might improve this? Anything that might make things more secure/anonymous?

My reason for this post is to spark a conversation about security and anonymity, not to endorse drugs or other illegal stuff.

Cheers!

PS. Really loving the new PC design of devRant

What is this format? Spaces are separated by + sign and columns are separated by & sign and it’s value is followed by = sign. Can I directly convert it to Spark dataframe?

What is the state of DevRant?

I've been away for quite some time.

Is scala language has future in bigdata?

Is that me or Lenovo cannot figure out the bios issue I am having with my ideapad-100. The Linux kernel says that the bios has a bug in it and then Windows can't update because the bios has a bug, the bios updater tells me the bios is perfectly fine. This is weird because the laptop is unstable whatever the Os and yeah it did that since I bought it and sent it to be repaired and still the issues goes on

I got my first proper start in programming through a side business operated by the same guy that was running a local makerspace. He had me learn basic git syntax and change some values in ionic.

From there I decided the best way to learn how to do this was write my own project in angular. From there I branched of with React and Vue.

The magic Apple Support:

A few days ago, I suddenly couldn't login to iCloud on my mac. I thought it was something that would be gone if I would try turning it back off and on again. Didn't work. Used the mac without bothering about it. I was too lazy to call the Apple Support and it didn't annoy me that much.
A day later, suddenly Spark (my email client) didnt work either, it asked me all the time to re-login into one of the accounts but "an authentication error occured". At that point I thought it was a problem with the keychain. Because i don't use email that often and the last time I should pay 30€ if I wanted to call Support (out of warranty), I just started using email on my phone.
Yesterday, MS Office (yes I use it and I like this Microsoft Product and I'm an Apple fanboy) wouldn't login either. I didn't call them.
Today, I had finally time to call them. They didn't want to charge me since I selected an Apple-Id Problem (and I think the Support Hotlines are free to call idk). The call from Ireland came 2 times and the connection didn't work (thanks iPhone). The third time, the moment the Support guy said Hello iCloud worked. A few second later Office and Spark worked again too. I don't know how these coincidences happen. Anyway, I am just happy my stuff works again and I don't have to use Google Docs and write my mails on my phone.

There is ads now appearing in the comment sections of certain post .. so far I've seen one, but it's a matter of time before more appears. Is there a spam filter ?

Can I use my devrant avatar on other platforms and, do I need to add a devrant watermark?

So... I have 5 Raspberry Pi Zeros (no Wifi), one RPI Zero with wifi and one RPI 2 b+. I want to do home automation stuff with them. Any ideas?
I was thinking openhab, my only problem is that the rpi zeros dont have wireless connections.

Recently helped someone with a Spark project and encountered “reactive JS” for the first and hopefully last time. Never minded using JS but happy to admit that it’s a dumpster fire design-wise…one that Spark engineers apparently decided didn’t have quite enough petrol on it.

We have an intern older than I am and a junior as I am of course I don’t know everything. But i would usually hint him things he should/should not do based on the devs team process pr the dos and donts. But he doesn’t listen most of the time. Only does what I tell him when he’s out of option. He obviously thinks he’s better, he would ask for my help but wouldn’t acknowledge my answer. Rather he’ll spark an argument even cutting me when I’m explaining it nicely to him. I even asked if he badly wants to prove he is correct and I am wrong, I’ll go ahead and ask a more senior dev. Andddd of course he cut me and did not let me ask the senior dev. Then i told him he could do the query himself. Anddd mother fucker shut up bcos I was right. Didn’t even hear him apologize or at least say he was wrong or just be humble and accept it.

Damn Apache Spark. Instead of supporting just one language that works perfectly well, let's support several languages that give users different results! It's so much fun to combine chunks of each language to get a fully working solution!

Do it's been about 19 days since my last update on my shitty internet and the upgrade that's meant to be in the pipeline for the current month.
Despite seeing people laying cable around my neighbourhood there's been no update on their website or in my letterbox.
It's halfway through the month and news outlets are reporting that the NBN has said that they:

Have 99% coverage
100,000 suburbs that aren't fully catered to

But, can't cater to a property that is in a relatively dense area less than 20km from a major city.

So I am running Spark on Docker. I have hardcoded the docker-compose file to 1 master and 3 workers which works fine. What would be a good way to dynamically scale the number of workers up and down through the command line ? I guess we have to use --scale or replica, but how ?

I am working with Apache Spark on Scala for my undergrad research. It got me thinking: what is Scala used for beside doing stuff with Spark?

Not sure whether it's just me but most posts talking about Scala seem to always mention Spark.

Finally, I got another me. It was so hard time for a long time. :)

I swear I touched some weird and complex programming shit in over a decade of programming.
I interfaced myself through C# to C++ Firmware, I wrote Rfid antennas calibration and reading software with a crappy framework called OctaneSDK (seems easy until you have to know how radio signal math and ins and outs work to configure antennas for good performance), I wrote full blown, full stack enterprise web portals and applications.with most weird ass dbs since the era of JDBC, ODBC up to managed data access and entity framework, cloud documental databases and everything.

Please, please, please, PLEASE I BEG YOU, anyone, I don't even have the enough life force to pour into this, explain me why the hell Jest is still a thing in javascript testing.

I read on the site:
"Jest is a delightful JavaScript Testing Framework with a focus on simplicity."

Using jest doesn't feel any delightful and I can't see any spark of focus and simplicity in it.

I tried to configure it in an angular project and it's a clustefuck of your worst nightmares put togheter.

The amount of errors and problems and configurations I had to put up felt like setting up a clunky version of a rube goldberg's machine.

I had to uninstall karma/jasmine, creating config files floating around, configure project files and tell trough them to jest that he has to do path transformations because he can't read his own test files by itself and can't even read file dependencies and now it has a ton of errors importing dependencies.

Sure, it's focused on simplicity.

Moreover, the test are utter trash.

Hey launch this method and verify it's been launched 1 time.
Hey check if the page title is "x"

God, I hate js with passion since years, but every shit for js I put my hands on I always hope it will rehab its reputation to me, instead every fucking time it's worse than before.

I am planing to create a reading list for technical books and am looking for recommendations.
Currently I have:
- Spark: The definitive Guide (need it for a university project)
- Clean Code
- Clean Architecture
- Functional Programming, simplified (or any other beginner-friendly book about FP)

Do you have any recommendations and must-reads for a more junior developer? I am looking for stuff about FP, Code Quality, Java, Python, Scala, and any general interesting technical stuff.

is there such thing has a facade in models to call on a database and return an iqueriable so that the controller use the iqueriable to get it's information ? it sounds a little odd to me.

My start up job got to spark. Problem I face is, completing things as soon as possible, problems are simple but even taking 2 days on something is a big thing. So, I'm just stuck doing lots of urgent tasks and I'm tired every other day because of this.
I don't want to meet people from my workplace as everyone is kind of workaholic and that also makes me not to do anything, I mean yeah, I can't handle stress, it's hell. Rather I want to work for a big company having interesting problems to solve and people who are professional and there to help you. Professionalism is not present here, managers are using bad words for their reportees, and that's a norm. My manager pinged me and literally said that I'm slow. WTH!!!

I have a question. I currently use PHP when creating my API's, however, I am unsure wether to move on from it. I use either laravel or lumen to do so and use vuejs for the client apps. I am proficient in Java and JavaScript and wondering wether I should move over to spring/spark or express. I have been programming for almost 10 years now and just finished my first year in uni. I want to appeal to employers for my placement year and I know they look down on php. So, should I go with java spring/spark or express ? Other suggestions are welcome!

how do you deal with the situations where you have no clue what happened in production ??

we have a Spark job and suddenly the job execution stopped in the middle without any error log. after sometime it started working again and all the master and workers were fine at that time.
now client wants RCA for that. 😟

I need to monitor the off heap memory of a spark on yarn application (executors, mostly) running in Java. Any tool/method that someone could suggest?

One of the things that gives me a lot of satisfaction is doing integrations. One customer has a good architecture, and they chose to put their metrics database with billions of records in Apache Cassandra. Which is pretty cool! A business consultancy that is helping them grow a lot, has implemented PowerBI and the dashboards are really good, but the most important reports will be based on this gigantic Cassandra database. We just delivered a quick integration using Apache Spark. Small project, fast delivery and everyone happy. Is so good. Mission accomplished feeling.

I am learning cyber security, the weird thing is, 90% of the times i find theory in lectures...so less practical content is present, even then web sites like tryhackme provide work machines which are next to use less if you dont pay for a subscription...FML!

Does anyone understand spark?

Hi! Is there a complex join operation for “updating” values in Dataframe using before and after values of the Uodate?

*learns solidity/smart-contract dev and is excited to start a blockchain revolution and spark new pathways to financial freedom*

realizes none of my friends even know what blockchain is, and don't care. feelsbadman 😢

I have unsubscribed myself from the Apache Spark mailing list but I keep getting emails from them regarding PRs and comments on the repo. What do I do now? Block them or mark as spam?

Um.. If you mute rant.. and someone ++es a comment of yours..any way to actually see who was it?!

I thought this just doesn't make notif icon spark up and supresses bolded stuff in all but that you are still able to see it under ++ tab if you switch, but nothing is there.. o.O

Spark is shit and is the definition of a write-only language. Change my mind.

Merging datas using spark sql with two conditions.
my code:
1.merge with first condition
2.merge with second condition
3. 1.unionall(2)
This gives some extra datas(total=10000 and result=10220)
$better way?any way?

The top reason was probably the people I surrounded myself with. I always loved computers and, as a result always joined cool tech-based clubs when I heard about them. The teachers there were also Devs and could do some awesome things with the code they wrote.
Hence me downloading eclipse and everything after...

So, I'm part of a pretty nice project with an awesome community. Being open source it didn't have really strict standards, evidence of this being one of the latest merges to master.
The latest merge breaks the project. It received approval because of some minor changes that were easily overlooked. Although they should have tested the build nobody bothered.
Now that it's been merged I've rebased several of my own requests I am unable to test them until the original author makes a fix.

Installed Spark on mobile ( termux ) and after a hourlong battle managed to connect it as a worker for the master in my laptop.

Doing these things made me understand how underpowered mobile hardware is. I couldnt even unlock my mobile when i ran the master ( just started it.. didnt even run anything ) in my mobile.

I want to defenestrate the bright spark who came up with JQuery.

Not really, but its fucking hard to use without a proper debugger. A pox on Visual Studio.

Anyone ever work with Hola Spark? First task at a new job is to integrate with it and any tips, tricks, advice, or lessons learned would be appreciated.

How to purge a table in Oracle through a Scala Application?

The fact that Spark web ui let you go beyond year 200'000 ad on the job planning view is quite concerning
:/

I’m trying to add caching functionality in my scalable spark cluster on Docker. I am able to add redis to my Docker container, but that doesn’t add redis-CLI or any other useful tools that I need. And there are some redis-cache projects on PyPi, but they are very old and not compatible with python3.

Is it just me or do we all dread error 500?

Debugging Spark errors is frustrating. Been running a model which takes an hour only to come across errors. And it's not even related to my code. Something to do with the cluster. FML

So today, at workplace, while discussing something we came at a point that why now a days many folks around us are screaming at JAVA or boasting about modern languages? where as many good concepts originated from it as well as even in many orgs the heavy lifting of huge tasks like in spark is done using java.
A thought came into my mind that, are we kinda becoming lazier by using languages like python, ruby which help to do tasks with little code?

It seems like it never came to the mind of the developers of Apache Spark that people might want to use two of their libraries together to perform graph analysis on streamed Twitter data.

Why can't I simply use the streamed batches to create and extend a graph and perform continuous graph Algorithms on it??

Why is my Spark Dataframe getting written as empty in the database table when deleting records? There’s no problem when inserting records, and I I have verified that my Spark Dataframe is not empty when trying to rewrite using Overwrite method. Then why is my whole table data getting deleted when I’m just trying to remove a few records using left_anti join?

I am a freelancr generalist 3d artist in need of some work experience. If anyone have some opportunity for me...contact please. I model cars/interior/exterior/abstract/etc.

So on my new position I get to work on Spark jobs. Never had to work with the infamous big data technologies. I never thought this would get SO frustrating for all the wrong reasons.

I'm currently trying to introduce integration tests for some Spark job I wrote. This isn't trivial though, as the data comes from several HBase tables. Mocking everything simply isn't feasible. So why not use the integrated HBaseTestingUtility? With it you can start a mini cluster that runs all nessecary services in the scope of your test.

Sounds great, eh? WRONG. Firstly the used mapr dependencies get in the way. The baked in configuration tries to automatically authenticate with your local cluster through Kerberos. Of course this doesn't work. And of course there is no way to reconfigure this as it happens IN A FUCKING STATIC BLOCK. AHHHH.

Ok. So after calming down I "simply" had to exclude all mapr dependencies and replace them with vanilla ones. After two days of dependency hell it FINALLY works!

...or does it? Well now we need test data. For that we got a map reduce algorithm that can import dumps. Sounds again, great, eh? WROOOONNNG.

The fucking map reduce mini cluster can't start, as it tries to write a symlink. Now take a wild guess what the sys admin here blocked. Yepp. TWO DAYS OF WORK RENDERED USELESS, BECAUSE OF SOME FUCKING SECURITY SETTING.

This is fine.

My Spark Program to process changes from Kafka topic to DB table is working end-to-end. But when it is manually terminated when an insert/update/delete is in progress, the whole tables data gets dropped. How can I handle this in a safe way?