Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
-
The highest data transfer rate today - 256 gigabytes per second - was achieved when the cleaner's vacuum cleaner accidentally sucked the flash drive in from the floor.10
-
So a friend of Mine asked me to check their Mail server because some emails got lost. Or had a funny signature.
Mails were sent from outlook so ok let's do this.
I go create a dummy account, and send/receive a few emails. All were coming in except one and some had a link appended. The link was randomly generated and was always some kind of referral.
Ok this this let's check the Mail Server.
Nothing.
Let's check the mail header. Nothing.
Face -> wall
Fml I want to cry.
Now I want to search for a pattern and write a script which sends a bunch of mails on my laptop.
Fuck this : no WLAN and no LAN Ports available. Fine let's hotspot the phone and send a few fucking mails.
Guess what? Fucking cockmagic, no funny mails appear!
At that moment I went out and was like chainsmoking 5 cigarettes.
BAM!
It hit me! A feeling like a unicorn vomiting rainbows all over my face.
I go check their firewall. Shit redirected all email ports from within the network to another server.
Yay nobody got credentials because nobody new it existed. Damn boy.
Hook on to the hostmachine power down the vm, start and hack yourself a root account before shit boots. Luckily I just forgot the credentials to a testvm some time ago so I know that shit. Lesson learned: fucking learn from your mistakes, might be useful sometimes!
Ok fucker what in the world are you doing.
Do some terminal magic and see that it listens on the email ports.
Holy cockriders of the galaxy.
Turns out their former it guy made a script which caught all mails from the server and injected all kind of bullshit and then sent them to real Webserver. And the reason why some mails weren't received was said guy was too dumb to implement Unicode and some mails just broke his script.
That fucker even implented an API to pull all those bullshit refs.
I know your name "Matthias" and I know where you live and what you've done... And to fuck you back for that misery I took your accounts and since you used the same fucking password for everything I took your mail, Facebook and steam account too.
Git gut shithead! You better get a lawyer16 -
I need a site with seo and advertisement.
The page should make about 750€ per month. I will only pay after site is complete and pays out.
You will get 150€5 -
My first boss. He sat next to me yelling “Think before you code“, “Hands away from the keyboard“ and stuff like that at me while doing my first few codings ever. He even made me cry from the pressure. Afterwards he bought me a muffin and told me he wants me to be a better programmer than he ever was14
-
This is how my day has gone so far:
1. In car, see advert about hackathon
2. Look it up, see tickets go on sale in 30mins
3. Read more about hackathon, apparently tickets go within minutes
4. Get tickets, print
5. Printer out of ink
6. Accidentally deleted ticket, can't reprint
7. No more tickets left so can't get another
8. Spend hours with data recovery tools
9. Remember recycle bin. Reprint ticket
10. Cry
11. Rant on devRant11 -
I’ve been thinking lately, what is it that devRant devs do?
So after a couple of days of pulling data from devRants API's, filtering through the inconsistent skill set data of about 500 users (seriously guys, the comma is your friend) i’ve found an interesting set of languages being used by everyone.
I've limited this to just languages, as dwelling into frameworks, libraries and everything else just grows exponentially, also ive only included languages with at least 5 users out of the pool.
sorry you brainfuck guys.
30 -
Facebook: "Our facial recognition automatically tags people in pictures."
Tesla: "Our deep learning algorithm drives cars by itself."
Andrew Ng: "I predict patients' likelihood of dying with 99% accuracy."
Google: "You know one of our algorithms is going to pass the Turing test very soon."
Wall Street: "We use satellite images to predict stock prices based how filled car parks of specific stores are."
The remaining majority of data sciencists: "We overfit linear models."2 -
What an awful day :(
The server where I host my 4 clients websites crashed.
Unable to reboot from the console.
I contact the support. 15 minutes later: "we'll look at this"
No news for 1 week despite my messages.
Then... 1st ticket escalation... 2nd ticket escalation... 3rd ticket escalation...
Answer: "Sorry, your server is down and cannot be repaired."
Fuck.
I ask "is there any way to get my data back?". Answer: "No, because we would shutdown the whole bay and all our clients would be impacted".
Fuck.
I subscribe to another server, at another provider.
I look at my backups... shit, the last one is 4 month ago!!
I restore the first website: OK
I restore the second website: OK
I restore the third website: My new server is "too recent" and not compatible. with this old Wordpress. Fuck! I'll look at this later...
I restore the fourth website: database is empty!! What??? I look at the SQL backup for this site... it failed...
I lost ALL my 4th client data!!!
I'm sooooo piece of crap!14 -
Professor essentially doing a dance to show data visualisation:
“Hey pay attention! I’m trading my dignity for your education”4 -
Was recently phone interviewed by a recruiter that asked "So do you know data structures and algorithms?" I replied "That's like asking someone if they know Mathematics - can you be a bit more specific?"7
-
!rant
Yesterday i updated my LinkedIn title to Data scientist.
Today morning i got 3 phone calls for job offers.9 -
When you have to figure out whether it's better to transfer 85GB of data via internet or to load it onto a harddrive and drive it 600 km/ 370 miles in your car.18
-
Less rant, more story.
Tl;Dr: Disney uses "Magic Bands" to track every action of every person within their parks.
So I took my family to Disney World this past summer and we got these "nifty" little things called Magic Bands. These things are little wrist devices that basically handle everything for you in the parks. It unlocks your resort room, it gets you into the parks, you pay for meals and souvenirs with it by connecting a credit card and/or your meal plan. It makes things real simple as it's like putting on your watch each day.
At first I kinda enjoyed how easy it made everything on the trip, but then as we were exiting a ride the couple in front of us noticed the digital signs had their names on them, I looked around and noticed mine too, a sign that said "have a good day $myName." It suddenly clicked. These "Magic Bands" are people trackers. Suddenly everything about the park that I had been enjoying, was part of the system they had in place using these bands as human cattle tags. The ride wait time estimations were perfect, not because of a good algorithm and estimations, but because they had actual real data telling them when a person entered the line and got off the ride.
Using a BLE scanner app I was able to see that they have hundreds of APs throughout the parks tracking every single band on every single person withing their compound. I started to think about all of the data they're collecting and the thought of it was overwhelming. The amount of assumptions they can make about people based on their actions within their parks and what that data would be worth to additional advertisers. By the end of the trip I was cynically pointing out everything to my family about the cattle tags and how much I hated wearing it and yet it was required in order to do anything.26 -
A CMS raping WordPress so hard up the ass till there is no tomorrow. I hate that bastardized piece of fuck. “Hey I want you to fix my page and its wordpress. I pay 20 bucks.“ Well fuck you too sir. Wordpress is no cms you wanna be coders. Get back to your fucking photoshop and design something original! Every fucking wp page looks the same. Every “nice feature“ is some kind of monkeypatched workarround. No problem i set preview pictures for every post just to enable some weird slider to function.
I also love those buttfucked files with just a “require foo“ which also just requires “bar“. Drop that fuck. Implement autoloading. Nobody uses php4 anymore step into the future. “easy to learn“ fuck me and fuck you untill you vomit jizz! Clusterfucked spaghetticode thats easy, easy to put another rotten load of clusterfuck on top. Also those security features. I put an empty index.php to prevent directory traversal. N I C E! Stop using wordpress as CMS, its a blog engine. Nothing great has every been written on top of wordpress and never will. I dare you to deny everything related to it and if you are one of those designer guyd, you can gargle my jizz you fucknut!
Starting 2017 i will start a counter and rape every 10th Wordpress which gets abused as cms i encounter into oblivion on their 0,99$ webhosting shit.
Fuck this I'm so mad about that crap17 -
I fucking hate python and myself even more. Python is easy they say, Python has nice syntax but fuck you . Fuck you seriously I cringe if I see non-c-like syntax. Every time I leave my comfort zone I get fucked over by damn semicolons. Fuck this imports i don't know your damn library. But god damn In far too advanced for hello world. There are two versions and the lib I want to use is incompatible? Well fuck me? That kind of shit never hit me on PHP. Damn me! Fuck you python. I want to know you but you fuck me harder than life. GEHÖRT? DU FICKST MICH HÄRTE ALS DAS LEBEN DU HURENSOHN!!!!
What is even your problem? Indentation? Well thank you for not having braces! I mean come on I try, I really do. I know you are different but every thing I want to learn about you is either for uber beginners or so advanced I don't even know what's going on. Do magical shit in a few lines? What the fuck is in those packages? A wizard full filling whishes like "plz make this work"?
But don't worry you cum snorting unicorn as much as I hate you I'm more mad about me for not being a descendant of fucking slytherin!14 -
Did you know?
This rant is a part of the 3 quintillion bytes of data that the world generated today.9 -
You may know about my dumb CTO, if not, read here: https://devrant.io/rants/854361/...
Anyway, the dumbass emailed me this weekend asking “what is big data?”
So I replied: “...it’s when you use a large font in your code...”
He thanked me. I bet he will be at some presentation somewhere and will reference using large fonts in an IDE!!!10 -
"Big data" and "machine learning" are such big buzz words. Employers be like "we want this! Can you use this?" but they give you shitty, ancient PC's and messy MESSY data. Oh? You want to know why it's taken me five weeks to clean data and run ML algorithms? Have you seen how bad your data is? Are you aware of the lack of standardisation? DO YOU KNOW HOW MANY PEOPLE HAVE MISSPELLED "information"?!!! I DIDN'T EVEN KNOW THERE WERE MORE THAN 15 WAYS OF MISSPELLING IT!!! I HAD TO MAKE MY OWN GODDAMN DICTIONARY!!! YOU EVER FELT THE PAIN OF TRAINING A CLASSIFIER FOR 4 DAYS STRAIGHT THEN YOUR GODDAMN DEVICE CRASHES LOSING ALL YOUR TRAINED MODELS?!!
*cries*7 -
Our Service Oriented Architecture team is writing very next-level things, such as JSON services that pass data like this:
<JSON>
<Data>
...
</Data>
</JSON>24 -
$50,000+ Computer Science fucking diploma, yet here I am on a Sunday evening doing data entry coz there is no one else to do it!11
-
Preface: My company took over another company. A week ago I inherited their IT.
"IT" !!!! Are you fucking kidding me?!
Their server stood at an ex employees homeoffice. So I drove to her and she had 0 idea about IT. Server was just "Running". I tore that fuck down and saw an aweful lot of Hentai in all home folders.
WTF?!
Not enough, their crm was a makroinfested access table. Shit was protected so I couldn't even edit the makros. The retarded fucktards hardcoded paths to serverside folder \\fuck\you\hard\cavetroll
Just so that server will never see the light of my domain! Damn you? Mothership of sisterfucking dickgirls!11 -
Hey guys
So, why so many rants about Facebook now?
I already knew that Facebook sells our data for a few years.... Didn't anyone else knew before that stupid #deletefacebook campaign?13 -
Are we just programmed to stay awake all night? Even if we have nothing to do?
Like, it's 4 a.m. in my country and I just can't fucking sleep! What is this?!11 -
Couple days ago found the DisneyResearch channel again and it's really addictive, impressive and scary to watch, here's an example: https://youtu.be/E4tYpXVTjxA
wonder how much data could be extracted from disney world/land visitors with that in the food service areas
3 -
I'm starting to hate js. Every library needs atleast 1000 other libs. I just blew the node_modules folder to 100mb with just one npm require17
-
I just deleted 3.5TB of junk data from S3, effectively saving my company about 88 dollars.
I feel so fucking good.
Think I'm going to ask for a raise😂4 -
WHAT THE FUCK IS WRONG WITH YOU APPLE?! THATS A SIXTH OF MY MOBILE DATA! WHERE IS THIS MUCH USAGE COMING FROM?????
8 -
Let me repeat this out and loud so that we are clear before another idiot starts pitching to me on building their "world class machine learning algorithm":
NO DATA, NO MACHINE LEARNING!2 -
Coworker: so once the algorithm is done I will append new columns in the sql database and insert the output there
Me: I don't like that, can we put the output in a separate table and link it using a foreign key. Just to avoid touching the original data, you know, to avoid potential corruption.
C: Yes sure.
< Two days later - over text >
C: I finished the algo, i decided to append it to the original data in order to avoid redundancy and save on space. I think this makes more sense.
Me: ahdhxjdjsisudhdhdbdbkekdh
No. Learn this principal:
" The original data generated by the client, should be treated like the god damn Bible! DO NOT EVER CHANGE ITS SCHEMA FOR A 3RD PARTY CALCULATION! "
Put simply: D.F.T.T.O
Don't. Fucking. Touch. The. Origin!5 -
Connect a pen drive, format it successfully. Connect to a new machine to copy data and see the data exists.
Crap! which drive did I formatted :(1 -
data science is just a sexy word for statistics.
1% programming skills
99% practically all science thats not computer science8 -
Windows: Would you like me to give all your data to MS or somewhat less data?
Me: Well .. I guess .. I'll choose the Basic option..
Windows: Here is a fun fact .. I'll send all the data regardless of your choice :)
This is what's happening in the background, I think. I mean there isn't even a phuqing option to turn this thing off.
19 -
“Commit“ sounds like the german “komm mit“(come with me).
NonDev coworker asked me what “Komm mitting“ is1 -
Warning:: Buzzword alarm!
I was doing smalltalk earlier and this guy asks me what I do for a living. me: I work for a company that builds software that is, among other things, able of giving your company prognosises how busy it'll be, so they can plan ahead. Him: ohhh, so like Big Data?
Me: *dies a little inside*... yeah, that's right! (didn't feel like having the talk with him at that point). No dude, not everything is big data 😥14 -
User: I need you to extract all the invoice data for us.
Me: What invoice data in particular, what are filters you require. This is a massive database with millions of transactions.
User: JUST EXTRACT THE TABLE!
Me: Right.....(this is a database with 3000+ tables and hundreds of joins)7 -
Oh shit i watched youtube with mobile data and i used 459mb... 31mb left to use it for 12 days... Shit12
-
!rant
Hello dear fellow devs, I got some more nice ram and don't need those ram bars anymore. Write why you should receive them and they are on the way. For people outside germany you (unfortunatly) have to cover the shipping costs.
17 -
So my parents got speakers integrated into their monitor. A few years ago (like 3-4) they made me turn off the sound because it annoyed them since all they did were playing some shitty flash games and some office work. Now they needed the sound back on and this is how it happened.
1. Confirm they plugged the right cable in. I know them so I knew that could be a problem
2. Made them download Teamviewer because I know they can't even doubleclick without guidance
Now the juicy part was to tell them they need to turn on sound on the monitor. As I was watching via teamviewer I saw them trying to click on the menu items from said monitor. Took me 5 minutes to explain that their mouse can't do shit on that because they need to navigate with the buttons underneath the monitor.
Turned out they couldnt get things right and I had no idea what they were seeing because they explanations went like "All I can see is Main Menu and Exit." - "Is that really all dad?" "Yes thats all. Main Menu, Brightness and Exit" turnes out the middle part is interchangable like "Brightness, Saturation, etc..."
After 2 hours I gave up and told them to pick up my speakers tomorrow -
!rant
Did you ever have that feeling of "what the fuck - how did I do THAT" - I just had one; I was fine with the algorithm taking like 15/25 minutes to fetch, process, save all data, now it shreds through 10 times of the previous amount in like 7 minutes.3 -
Talk about data protection, I am fucking furious!! A hotel i stayed in recently has sent an email with a scan of my passport and credit card. Do I have any legal rights to fuck them up the arse? The hotel is in france.1
-
I don't get all the amazement etc people show when they find out that I don't use services like WhatsApp, Instagram, Gmail, Outlook, Google etc, why would it be 'weird' to want control over who has/owns your data? That's not being fucking paranoid, that's being conscious about who you give your data to.1
-
Recently found an artist called "Big Data". His song titles describe what Big Data actually is really well:
-
If I had a company. I would only accept code for application. Grades, gender, age... i couldn't care less7
-
Want to make someone's life a misery? Here's how.
Don't base your tech stack on any prior knowledge or what's relevant to the problem.
Instead design it around all the latest trends and badges you want to put on your resume because they're frequent key words on job postings.
Once your data goes in, you'll never get it out again. At best you'll be teased with little crumbs of data but never the whole.
I know, here's a genius idea, instead of putting data into a normal data base then using a cache, lets put it all into the cache and by the way it's a volatile cache.
Here's an idea. For something as simple as a single log lets make it use a queue that goes into a queue that goes into another queue that goes into another queue all of which are black boxes. No rhyme of reason, queues are all the rage.
Have you tried: Lets use a new fangled tangle, trust me it's safe, INSERT BIG NAME HERE uses it.
Finally it all gets flushed down into this subterranean cunt of a sewerage system and good luck getting it all out again. It's like hell except it's all shitty instead of all fiery.
All I want is to export one table, a simple log table with a few GB to CSV or heck whatever generic format it supports, that's it.
So I run the export table to file command and off it goes only less than a minute later for timeout commands to start piling up until it aborts. WTF. So then I set the most obvious timeout setting in the client, no change, then another timeout setting on the client, no change, then i try to put it in the client configuration file, no change, then I set the timeout on the export query, no change, then finally I bump the timeouts in the server config, no change, then I find someone has downloaded it from both tucows and apt, but they're using the tucows version so its real config is in /dev/database.xml (don't even ask). I increase that from seconds to a minute, it's still timing out after a minute.
In the end I have to make my own and this involves working out how to parse non-standard binary formatted data structures. It's the umpteenth time I have had to do this.
These aren't some no name solutions and it really terrifies me. All this is doing is taking some access logs, store them in one place then index by timestamp. These things are all meant to be blazing fast but grep is often faster. How the hell is such a trivial thing turned into a series of one nightmare after another? Things that should take a few minutes take days of screwing around. I don't have access logs any more because I can't access them anymore.
The terror of this isn't that it's so awful, it's that all the little kiddies doing all this jazz for the first time and using all these shit wipe buzzword driven approaches have no fucking clue it's not meant to be this difficult. I'm replacing entire tens of thousands to million line enterprise systems with a few hundred lines of code that's faster, more reliable and better in virtually every measurable way time and time again.
This is constant. It's not one offender, it's not one project, it's not one company, it's not one developer, it's the industry standard. It's all over open source software and all over dev shops. Everything is exponentially becoming more bloated and difficult than it needs to be. I'm seeing people pull up a hundred cloud instances for things that'll be happy at home with a few minutes to a week's optimisation efforts. Queries that are N*N and only take a few minutes to turn to LOG(N) but instead people renting out a fucking off huge ass SQL cluster instead that not only costs gobs of money but takes a ton of time maintaining and configuring which isn't going to be done right either.
I think most people are bullshitting when they say they have impostor syndrome but when the trend in technology is to make every fucking little trivial thing a thousand times more complex than it has to be I can see how they'd feel that way. There's so bloody much you need to do that you don't need to do these days that you either can't get anything done right or the smallest thing takes an age.
I have no idea why some people put up with some of these appliances. If you bought a dish washer that made washing dishes even harder than it was before you'd return it to the store.
Every time I see the terms enterprise, fast, big data, scalable, cloud or anything of the like I bang my head on the table. One of these days I'm going to lose my fucking tits.10 -
There are always three questions i get asked when i tell people I'm a programmer:
Can you take a look at my phone/laptop/pc etc...?
Can you hack?
Whats the green stuff from matrix?3 -
Google collects more data than I could imagine.
So i read an article a few days ago and it absolutely blew me off. It mentioned how google collects your personal data and makes it available to you as well (just to rub it in your face I guess). E.g
1. Visit https://google.com/maps/timeline/ : Collects exactly what it says.
2. Visit https://myactivity.google.com/ :
These people collect everything on your device(at least android)!!!!! Even the time spent on home screen! WTF!!!
3. Visit https://takeout.google.com/ : To download your data archive. Ranges from Google photos to Hangouts and everything in between.
-> All the above require signing in with your gmail account.
So basically, if someone manages to get a hold of your gmail password, they have the power to know everything about you.
Aaaahhhhhhh. Ridiculous.9 -
OH MY FUCKING GOD!!!!! FUCK YOU SPRING-DATA-NEO4J YOU ARE DRIVING ME CRAZY YOU SHIT FUCK !!! FUCK YOU AND YOUR DELETE ON SAVE BULLSHIT!!!! OMFG!!!!!!! EVERYTIME IS SOME FUCKING SHIT THAT DELETES OTHER SHIT THAT SHOULD NOT HAVE BEEN DELETED!!! JUST FUCK YOU ALREADY IM GONNA REWRITE ALL THIS SHIT!!!!!!!1
-
I wonder if I should open source CZip....
It saves data usage of streaming movies.
2hr movie = about 500mb data usage12 -
#10 year challenge is basically data set father for new ai which will predict how X looks after 10 years
Data mining at its best2 -
Devrants mobile data usage is so low. Really love don't needing a good connection and don't using to much of my mobile data when using it :)
Also: Grammarly STOP auto-correcting devrant to servant ALL THE TIME...5 -
Everytime I want to use a well recommended library which last commit was two years ago or longer i get suspicious2
-
Today I dropped and updated a database to override it with local changes. Turned out the same dB was used by another project.
I just destroyed a week worth of work and content.
Good thing I took a dump before dropping everything. Got it running in 5 Minutes7 -
"The client is complaining that the data takes a long time to load."
Me, after investigating: "Does the client really need [not an exaggeration, actual figures] 130,000 rows of data?"
"I will show them these stats but they said they need it"8 -
Gdpr thing aside...
Does anybody read the new policy...
I just did for 2 apps (intel driver software and 9ga.. You know it)...
On the things that they collected on the side without you knowing include:
9ga:
Device memory, language, battery level, timezone, unique device identifiers, compass, accelorometer and microphone... Even service provider and signal strength
Intel:
Website you visit, how you use your computer(vague too vague) and computing environment.
Did anybody knew for sure before this that their apps are listening to them? That they just made a profile of you with all the data?
With all this they dont even need your ip they already know who you are and what you do on a daily basis...
There are 20 more but it will be waaay too much to write about. These 2 are way worse since 9ga doesnt use microphone for anything... And why a driver reads what websites i am going to?4 -
I accidently lost a whole tables data today. Lucky me I also created a XML-file on the server which was for printing.
I parsed the files back into a simplexmlobject and recovered most of the lost data. 💪13 -
Forgot to turn off mobile hotspot when I connected my phone with a Windows PC. Fucking windows used all my data to download 'security' updates. Bhenchod.10
-
Saw a reddit thread earlier asking about the most unsettling shit that people have found out Google has on them by downloading their data. I saw a bunch of comments about people finding voice recordings that Google had taken. After reading these, I was wondering what I could find from downloading my data. Decided to download my data, and on the page for it I saw that apparently I had disabled location history, audio activity, and device information.
Knowing companies like Google, I wouldn't be surprised if they didn't stop recording that stuff, just that they're not providing it to me. There were zero voice recordings, but there was location history up until about the beginning of 2017.
Another thing they have is all the pictures from all of my hangouts chats. Apparently there had a good amount of older pictures of myself in there. Going back to probably 2-3 years ago, when I had my emo hair. Just a bit of a throwback. One picture I saw was from last January, when my hair was reaching my chest. Made me really miss my hair.
Other than that, nothing that interesting. Just something I thought I'd share.12 -
When you hear the data engineers talk about ambari, storm, sqoop, kafka & phoenix and you are not sure if they are talking about frameworks or pokemons..
2 -
Anyone who has watched Black Mirror and thought what shit it is and technology can never go that far but wonder what if it does and we all are fucked.
Or we are already there but mini version of it. I see people glued on there phone, screen, and even I am guilty of that. But the amount of data we create everyday which can be treated as huge asset by the AI and Data mining enthusiast, I dont doubt we will be at a breaking point, which is coming sooner than we think.12 -
Got myself into Facebook's Graph-API...
...everything is so easy and well optimized.
NOT! Now I have to optimize the request to reduce loadtime. Why is there data so fractured? -
I - Lets move your database to mlab. They offer 512mb database for free, every month. That is beyond your lifetime usage
Client - No. They Steal Data ( Like Facebook )
And client don't know a shit about mlab and development. Aware of quite a few names, bigrock, godaddy, bluehost. Even AWS is not in the list
- mlab is mongodb database service4 -
I remember the first time I was experimenting with Linux and decided to install Kali Linux (was still version 1 at the time) and in the process cleaned my hard drive. I was in first year and I hadn't been introduced to git, so you can imagine what happened to my code.
Or when I dumped all my databases into one SQL file (the feature looked tasty in phpmyadmin) and then after reinstalling everything, I couldn't import back the files.
Or last year, where I was on industrial attachment. So we were to delete some data from DHIS2 manually. So as a developer I grouped all organisation units to be deleted under one parent and wrote a python script to recursively delete anything in that group. Just when I was about to show my supervisor how efficiently my script was deleting stuff, he said, "Don't delete anything yet". I hope he doesn't read this *wink*
Fast forward, last week on Friday I dropped my external hard drive. It just works on one USB port now, no idea how and why. -
Oh my fucking god. Austria wants to sell the data of it's citizens to schools, universities museums, and: Companies with enough money. What the fuck?
The data contains shit from the central register of residents, information about name, date of birth, sex/gender, nationality, recidence, health data (!), education, social security/insurance, tax data, E-Card/ELGA Data (system where your doctor visits, prescribed medicines/drugs, all these things, are saved), and other shit.
Welcome to 2018, where you can try as hard as you want to keep your privacy, and then your government sells all the shit you are not able to remove. Fucking bullshit.9 -
One thing when working with a ton of data:
If there is a slight, infinitesimal probability that something will be wrong, then it will 100% be wrong.
Never make assumptions that data is consistent, when dealing with tens of gigabytes of it, unless you get it sanitized from somewhere.
I've already seen it all:
* Duplicates where I've been assured "these are unique"
* In text fields that contain exclusively numeric values, there will always be some non-numeric values as well
* There will be negative numbers in "number sequences starting with 1"
* There will be dates in the future, and in the far far future, like 20115 in the future.
* Even if you have 200k customers, there will be a customer ID that will cause an integer overflow.
Don't trust anything. Always check and question everything.5 -
Computers fear my devaura. Everytime I get called to fix something it magically starts working when I enter the room. 5 Minutes after I leave it broke again.
Repeat like while(true)3 -
Holly shit, they will never understand....
If you come to dev, minding his buissness, writing some code, beeing focused, with headphones on, etc. You absolutely destroy his cache of things in mind, you stay next to him gazing at his screen and throwing away madly words that you need some data extracted from database NOW and you will stay standing next to him gazing when he quickly types few lines of ultra-wide screen of SQL querry with all the fucking joins and shit you wanted with exac aliases you understand and makes one typo but query executes and spits out some data. He didn't notice that something is wrong with it becouse he didn't memorize database's data, and he sends it to you.
Now you are coming back to him pissed and in general fighting mood becouse he did one fucking typo when you was actively pressurizing him to make fucking query faster while you absolutely destroyed his flow of work (in meaning he now needs to dive back into code, figure out why he was editing given file and what was idea for further structure)
Now you are standing again next to him and absolutely pissing him off that he fucked up and made one fucking typpo that unfortnately database didn't say "nope" but it instead spit out wrong data.
If you can relate to "you" stated above, sincerly fuck you.
If you can relate to "he" stated above, I feel ya man, its fucking annoying, isn't it?2 -
How many of you use the right data structures for the right situations?
As seasoned programmer and mentor Simon Allardice said: "I've met all sorts of programmers, but where the self-taught programmers fell short was knowing when to use the right data structure for the right situation. There are Arrays, ArrayLists, Sets, HashSets, singly linked Lists, doubly linked Lists, Stacks, Queues, Red-Black trees, Binary trees,.. and what the novice programmer does wrong is only use ArrayList for everything".
Most uni students don't have this problem though, for Data Structures is freshman year material. It's dry, complicated and a difficult to pass course, but it's crucial as a toolset for the programmer.
What's important is knowing what data structures are good in what situations and knowing their strengths and weaknesses. If you use an ArrayList to traverse and work with millions of records, it will be ten-fold as inefficient as using a Set. And so on, and so on.37 -
Husband looking into online schools for CS. Anything data science related. He loves math (and is freaking good at it) and teaches himself R for fun.
I put 0 thought into my own schools (terrible, I know, but not likely to change any time soon). Any suggestions for good online data Science programs, with a math minor potentially?
It's for his bachelor's.7 -
I just switched to iOS and it's being an amazing experience.
So great to finally have access to all my files, and personalize my device as much as I want.
And it has no virus so it's all good news.1 -
The worst thing about university is having to listen to lecturer say DATA MINING IS GOOD at every single lecture there is.1
-
I hate debugging document oriented data types..
Can't even sysout easily like primitive data types.
Need a debugging duck.1 -
Wow! Just updated my devRant android and it has search! Opens the floodgates to data mining the rapidly growing content. Thanks!!!3
-
What is it about robot collected data that makes researchers so anal? Like, dude, it's not even personal data. It's literally robot's joint motor recordings. It's not nuclear data, so why the fuck do you protect it like your life and your country depend on it?
I hope you get fisted by that data every night and how it will end up in oblivion sooner because you didn't publish it. You asshole.8 -
One of my colleagues who thinks he knows all about "big data": "I try to put everything in hadoop, that is my philosophy".
We don't even have a hadoop cluster. -
Opened my PC today...found my local disk empty...170gigs of data lost...
Feel like crying...hope Recuva works3 -
When your company has data integrity issues and they expect hacky workarounds instead of fixing the data
-
Code like this makes me shed a tear in nostalgia... also I want to murder somebody for still putting that in tutorials
5 -
Had to submit a form and couldn't because of some js errors. I hacked my way through with the console to submit none the less
-
Sending email to client (the following is a short version of it)
"
Dear Data Evaluation Team,
Here is a link with the password to the data export for the questionaire.
You will find in there 4 sections:
1. Utilization Report
2. Question List
3. User Responses to questionnaire
4. Summary of responses
"
Email from client
"
Thank you data team.
I see that the user responses have some ids for the questions. Can you please give me the full question text, where is it?
"
My response
"Section 2, Question List"
Like really? Did you just not f*ing read the email and just jumped into the data export blindly. I wrote some fucking docs for a reason. -
A few years ago I worked at company specialized in Magento(eCommerce) and Magento was changing their licensing model. At the time they had 3 Versions. Community(free), Pro and Enterprise.
They decided to ditch Pro and either make all migrate to Enterprise(with a discount) or go community which wasn’t really compatible. So some shops were in need of a more or less complete rewrite.
My hdd crashed literally the day before but hey no big deal everything is 99% done and on staging. So I had a Trainee at that Time and thought the last few crappy things could be done in pair programming so he can learn a few things.
But fuck him! That motherfucker! He managed to WIPE the staging server and no that was at a time without gut and no SVN. That dipshit just deleted 2 months of work because he thought it was a good idea to SYNC his empty project to the staging system.
Oh god I nearly stabbed him. He did that shit out of his own mind even though I told him a dozen times what would happen... we had to do the whole thing again with me sitting next to him watching every stroke he made.
Guess he learned something while inward silently raging the next weeks.1 -
A few minutes ago, I was going crazy over a bug caused due to data mutation in Rails.
Basically, user1 was creating a post record and it's stored in the database normally however, on page reload for a second user, user2, the post (that user1 created) was update to belong to user2. This is because, on page reloads, I was using `<<` method call to append user2 and user1 posts together! Apparently, `<<` not only mutates the array, it also performs a database update.
Kill me please!!
Also, data immutability seems a more reasonable feature in languages now.1 -
You know that the Algorithm & Data Structure exam is coming, when you start traversing binary search trees in your sleep2
-
I wonder, are some apps on purpose made to be small size, but then later when you open them force you to download the actual data made with converting people that are low on space or dont want heavy apps to actual download numbers? since if they now after discovering that, delete the app - they already have boosted the downloads
I can understand pulling offline databases or game updates from own servers to get the newest data, but sometimes you come across apps that have no need in any of those and could just e.g. package the audio which will never be updated5 -
!rant
Looked into browser jank and how to optimize large lists of images in a scrollbox, went from 20fps while scrolling to ~60fps ❤️ -
what's your expirience with business intelligence / data science? Do your company has a own department for it?
If so how does it affect you?2 -
I feel for you guys,
My inbox is bombarded with emails asking me to give my permission for saving my data again, thanks to the new European data protection laws, which will go live the day after tomorrow.
Which means a lot of you guys are doing overtime today and tomorrow to work towards this deadline. Not me, though. Still. I want to share two sentiments with you:
1. Whatever management just decided at the last minute that they need that done before Friday, fuck them.
2. I repeat my initial words, I feel for you. -
i was learning neural networks, started with keras and was on the first tutorial where they started by importing pandas
so i switched to learning data analysis using pandas in Python where they started by importing matplotlib and i realized data visualization is also important and now I'm reading matplotlib docs...🙄11 -
I've just spent the last hour or so banging my head against a brick wall trying to figure out why I'm unable to retrieve some data via AJAX even though I know data is being returned as I can see it in my error log.
Turns out the permission system I wrote a few days ago actually works and because I didn't specify a permission it automatically denied my user from retrieving the data. One thing I forgot to add was an error message to tell me when I don't have sufficient permission to do something. Adding a message could have just saved me a lot of time :/2 -
Am I Data Engineer or Software Development Engineer ?
I design the infrastructure for analytics data, and I build the infra entirely including an development. Except making reports out of the data.
What I'm supposed to be called ?
Data Engineer ?
Software Development Engineer ?
Definitely not an Data Scientist. Official designation given by company is Data Engineer II. But what I'm ?
Confused, someone help me please.5 -
2018: Data Scientist = Stack overflow copy pasting: "I followed a 12-hour 'DS' course on Lynda!"
lm() # science2 -
A follow up rant to my former rant. I am not a hardcore privacy guy myself, but this is more of a matter of principle.
ts legit fucking bullshit how the bank just called me, if i didnt send a hell lot of informations about myself, then my bank account would be deleted and lose all my savings and money.
Its ridiculous how banks themselves have been able to do money laundering of billions of euros and the governments responds to this is to criminalise the average citizen by collecting a hell lot of data.
We are also talking about how companies are collecting data, and the laws the protect us from them, but in the end its pretty useless, so long governments are able to do whatever they want and we cant do anything about it.6 -
I'd like to make an open source data registry, with an easy to access API. For example, perhaps I'd like to list all cities and postal codes in France, or perhaps get the number of dogs in Canada. Any ideas how to structure the open source part? How can people contribute? Should it use external APs?2
-
Anybody have any great tutorials about web scraping with python? The data science courses I took only covered maipulauting and visualizing data not getting it.4
-
Imagine an annual $50k+ enterprise software package that didn't distinguish between a null and an empty string in valuing critical data. Not noticed for years - wtf?3
-
To solve an issue of slow data retrieval on an app, I suggested pre-loading the data once a week and storing it in a spreadsheet ready for instant download.
"Great idea. If more data gets added to the database after we download the data, will the spreadsheet we downloaded also update?"
Seriously, I understand that not everybody is technical but fuck me how do you expect us to update a file on your computer? -
I decided to try and see if I can live on my 3GB mobile data plan for work and study today. For 3 hours, I just burnt 200MB by ssh, whatsapp, telegram, browsing forums to fix ticket, and reading manuals.
Guess I have to rely on my customer's restrictive WiFi. Sigh.6 -
!rant
Started Data Science course on big data universuty. The outcomes are heavily dependent on domain experts/stakeholders!!! Since all the answers are false positives and need to decide what make sense with the help of domain experts. And most of the Data scientists are not from programming background, they are domain experts who turned into Data scientists. Thoughts if I should continue with learning big data/data science, knowing that I have knowledge in information retrieval and search engines. -
Hey guys any advice/study plan for a 22 year old C++ Server developer to transition into data science ?
P.s. currently based in London4 -
The codebase Im working with is like someone took 3 sets of earphones, crumpled them together in their pocket, and then threw them into a bag full of spaghetti and wasps. Too confusing to comprehend and dependencies absolutely everywhere. All I have to do is port over a relatively straightforward piece of functionality from one iOS app to another. Core Data has other plans it seems....
-
Question & Android
Is there a way on android to limit what apps are allowed to use mobile data and what are only allowed to use wifi?11 -
Recipe for reverse engineering data structures / binary formats:
1℅ understanding the theory.
1℅ expections about what you will find.
3% luck.
45% trial and error.
50℅ persistence.2 -
Went to a Big Data workshop, now I know why there's a elephant as hadoop's logo and how it came. Still no clue how it works.
-
So we are gonna have a presentation offshore in an international event, in some hours from now.
Boss asked me to update some data along with some that a coworker was working on.
I asked about said data to coworker and she replied: they are in dropbox since yesterday.
And I was like OK.
AND NOW I'M FUCKING AWAKE AT 3 AM TO UPDATE IT AND 80% OF THE FUCKING DATA ISN'T ON THE FUCKING DROPBOX!!!! WTFFFF!!!!! -
According to a report from VentureBeat: Verizon Media has launched a "privacy-focused" search engine called OneSearch and promises that there will be no cookie tracking, no ad personalization, no profiling, no data-storing and no data-sharing with advertisers.
By default, Advanced Privacy Mode is activated. You can manually toggle this mode to the "off" but you won't have access to privacy features such as search-term encryption. In the OneSearch privacy policy, Verizon says it it will store a user's IP address, search query and user agent on different servers so that it can not draw correlations between a user's specific location and the query that they have made. "Verizon said that it will monetize its new search engine through advertising but the advertising won't be based on browsing history or data that personally identifies the individual, it will only serve contextual advertisements based on each individual search," reports VentureBeat.
https://www.onesearch.com/7 -
Data Structures professor enters class, today's topic being RBTs. He opens slides, forgot to redact the name and university from where he blatantly copied it from. Continues anyways. *Facepalm*6
-
I have a freaking cool, useless idea, but i dunno if it will actually work
1. Put a usim in the slot
2. Reads information and connects with ISP
3. Turn on mobile data
4. Turn on hotspot
5. And useas a portable wifi
Don't ask me why you don't bring my phone, there are reasons
The os will be no screen only physical buttons with stripped down aosp
Can it work? Or in other words, is it possible?14 -
So after another data analytics class, I have Beyonce's song playing in my head as:
"All the shingle ladies, all the shingle ladies" -
Function works() {
Try {
HorriblyDyingCode();
Return true;
} catch (Exception e) {
Return false;
}
} -
Let’s just face it. Once the majority of people understand, data science (machine learning on custom behaviour mostly) will be the most disgusted job in the world. Mind boggling! You get shot right between the eye by doing it.
4 -
I’ve been reading this book “Designing Data Intensive Applications” by Martin Kleppman. The concepts are really well explained !!2
-
Personal data in exchange for a coffee coup. Must be a joke, wait is for real.
https://npr.org/sections/thesalt/...4 -
Sometimes I just wish Core Data would die.
I logged the managed object context of each object being touched and they're all identical. 😑😑😑😑😑😑
1 -
DEAR NON TECHNICAL 'IT' PERSON, JUST CONSUME THE FUCKING DATA!!!!
Continuation of this:
https://devrant.com/rants/3319553/...
So essentially my theory was correct that their concern about data not being up to date is almost certianly ... the spreadsheet is old, not the data.... but I'm up against this wall of a god damn "IT PERSON" who has no technical or logic skills, but for some reason this person doesn't think "man I'm confused, I should talk to my other IT people" rather they just eat my time with vague and weird requests that they express with NO PRECISION WHATSOEVER and arbitrary hold ups and etc.
Like it's pretty damn obvious your spreadsheet was likely created before you got the latest update, it's not a mystery how this might happen. But god damn I tell them to tell me or go find out when the spreadsheet was generated and nothing happens.
Meanwhile their other IT people 'cleaned the database' and now a bunch of records are missing and they want me to just rando update a list of records. Like wtf is 'clean the database' all about!?!?!?
I'm all "hey how about I send you all records between these dates and now we're sure you've got all the records you need up to date and I'll send you my usual updates a couple times a day using the usual parameters".
But this customer is all "oh man that's a lot of records", what even is that?
It's like maybe 10k fucking records at most. Are you loading this in MS Access or something (I really don't know MS Access limits, just picking an old weird system) and it's choking??!?! Just fucking take the data and stick it in the damn database, how much trouble can it be?!!?!?
Side theory: I kinda wonder if after they put it in the DB every time someone wants the data they have some API on their end that is just "HERE"S ALL THE FUCKING DATA" and their client application chokes and that's why there's a concern about database size with these guys.
I also wonder if their whole 'it's out of date' shit is actually them not updating records properly and they're sort of grooming the DB size to manage all these bad choices....
Having said all that, it makes a lot more sense to me how we get our customers. Like we do a lot of customer sends us their data and we feed it back to them after doing surprisingly basic stuff ever to it... like guies your own tools do th---- wait never mind....1 -
Was rushed to write a crappy massmailing for super urgent newsletter, had to be finished in 20 minutes. Last 5 minutes i had to rewrite half of it. Told them its rushed, testet and crappy.
Mailed the stuff anyway. Every Email got the same dynamic string in subject.
Looked at code, was setting the subject 2 lines above the loop.
Sorry guys, dont rush me next time2 -
How many languages does one have to learn...? Learnt C, C++ and Java because of college courses. Learnt HTML, CSS, and vanilla JS because I wanted to learn frontend. Now learning R for big data analytics. Today, I came to know that I need to learn more Java or start learning Python for Hadoop...!!
😧😵1 -
I really want to dive deeper in other languages. But everytime I see something with a not c-like syntax i can't muster the resolve to dive in.
Any advice to overcome that?3 -
Here we go. GDPR(?) again.
Don't know where to ask this kind of stuff, SO is prolly too much and from my experience, you guys here always gave the best answers to stuff..
I'm currently working on a website as a project for finals (it's called Maturita/SOČ here :/) and it's supposed to be a dasboard where teachers can add some info about upcoming stuff and shit like that. Few things: No frameworks, just JS, PWA and Firebase. I've been hearing a lot of stuff about GDPR that I should comply with it and so on.
Here's the question: It's PWA and the data is currently stored in localStorage and planning to sync it to Firebase. What I store is name of the school, few URLs they enter in and the information they provide, like the upcoming events and such. Should I worry about GDPR in this case, and if so, what can I do?11 -
Executed chown -R www-data:www-data /var/www on my server without even thinking.
Not long after I panicked for a few seconds while checking if everything was still working. I didn't know if this command would break stuff or not.
So glad all websites are still working.
Now I'm sitting here thinking: was I braindead while executing the command??
All I wanted to do was set the right permissions for certain folders because images couldn't be uploaded with PHP.6 -
When you wanna be a Data Scientist and always land into internships where you are assigned with web development...
Learnt Node, Flask, Spring frameworks across different internshis... -
Found an institutional coaching centre leaking 1000s of students personal data phone, photo, db, parents info, documents photo path, payment method(bank, check, card) etc. They 32567 rows. I'm trying to find the admin login page. It seems they have it on separate subdomain. I found student login and I can login as any student. I hate these institutes. Sent them emails days ago (29 sept) but no reply yet. What should I do?2
-
Trying to learn something new.
Find a library in a foreign language. It's c++.
Unable to include lib.
Copy contents
Try absolute path
Compiler gives me the finger
Abandon project -
A few years ago:
Installing Visualstudio 2008 on Xp.
Pc is laggy as f.
Start browsing nsfw to kill time and boss comes over. Try to close browser and not working. Start to panic a bit. Boss comes over looking at black boxes.
Pictures didnt render. I was so lucky1 -
Data scientists should be charged with animal trafficking and animal abuse because they import Pandas 🐼 and feed them to Python 🐍2
-
Jesus Christ! Every time I'm working with some code that involves the word "data" I'm guaranteed to make a typo and type "date"!2
-
Can anyone explain to me why facebook got pulled over for selling user data and google hasn't yet?5
-
Real question:
If I save your data in the cloud and it's raining outside, will I lose my data? or Am I safe?5 -
So I get this email from google for my development account about these new general data protection regulations and what they're doing with admob and all that good stuff.
I didn't dive too deep and there's nothing crazy in it but it definitely feels like it's spawned on by this "selling you data to advertisers thing."
We live in such a weird society where it's like outrage after outrage. I've never known anybody who has NOT known that their statistics and data was sold to third party for marketing for EVERYTHING they do on the computer or phone. For a DECADE or longer. It always seemed to be such a second hand thought but now out of nowhere everyone has their panties in a wad for something they ALREADY knew.
Are we like that miserable/bored/no hobbies/unsatisfied with our first world life that we have to just flip out about dumb crap all the time? -
So today in school I decided on my career choice. So I've decided on becoming a data scientist because I can still use my programming and I very much do like looking at data and researching things as well as program obviously :) so if there are any data scientists or data miners out there do you have advice?5
-
The customer told us that we have had a good momentum lately and that we need to keep it so that we can finish on time. What makes me frustrated is that what he perceives as "momentum" actually is increasing technical debt and overtime work...2
-
*-- There's something kind of child like and adorable about working for a client who spends THOUSANDS of dollars on their data infrastructure, yet finds it ever so difficult to provide ONE user to help reconcile and test the new data warehouse.
-
I received the following e-mail today:
Hey, XYZ! Could you please check the following in your web application. The data do not show correctly. Could it be a bug?
[insert attached screenshot with said "bug"]
My reply:
Hey, ABC! It is not a bug. You uploaded the data into the wrong table. 😊
[insert attached screenshot with the incriminating evidence]
-----------------------------
I felt a bit savage and I liked it. 🔥4 -
Not sure what I wanna do ---
Backend Development or Data Analyst
Even in backend development confused between nodejs, PHP, Python though I don't have proper knowledge of all of them.
For Data Analyst I am looking the way from where I should start.
I am in 3rd year of my college
Can anyone please help me with this?6 -
I need help!
I have recently scraped ALOT of news article data and formated for training data. This adds up to 5.6gb. Where can I upload this for people to access as I think it's quite useful. I have tried GitHub LFS ( Large File Storage ) but topped out account at 1gb. Also I don't really want to pay for hosting.2 -
I am excited about Websocket getting more popular. I just completed a project using it. It is so good for sending market data to the front.
-
So I cant resize the window and I can't scroll down anymore... Where the fuck is "below" so I can turn "off" data collection 😤
2 -
Fucked a clients wordpress website up by editing a saved option thats saved as serialised php data. Tried using the row data from a backup and updating it in the database and it still loads the fallback theme settings. What do?5
-
FEAR OF DATA LOSS
Resolution => backupS
1: external drive (or NAS)
2: cloud storage (maybe multiple services)
3: git repositories
After all these backups you are kind of demigod of data recovery...8 -
I hate data structures. I try to work out their algorithms in my head but they're completely counterintuitive. lol.7
-
I took a project. Wild mix of php and html including db stuff and data processing. About 200 files, some 3000+ lines long with if else cases processed in another template/logic behemoth...
I wrote a js file included it at the footer of the monster and update dom + data via ajax on my own api implementation because I'm too afraid to write in any of those files.
I've been told its quality code and well documented3 -
Got a file with cobol data in it.. Also got thr structure to read it, but what the fuck is COMP-3? Any idea how I can decode this into a human readable format? 🤔😓🤓
-
i previously had Windows 10 and somehow my Windows was deleted so i installed Ubuntu and wiped the hard disk
can u suggest any full data recovery tool in linux from which i can recover the data i had in Windows.1 -
Quick question on Android development. Is it good practice to access UI elements from code, i.e R.id.example? Or is there something similar to WPF's data binding?10
-
I was wondering if it is allowed to crawl all posted rants on devrant to do some fancy data mining stuff while learning python. Any clue?3
-
A note to the team designing recommendations on google ads:
Just because I search for deep learning concepts for personal learning, does not mean I will be purchasing every paid online data science course on the planet.5 -
I'm all for alternative methods of learning but this post on FreeCodeCamp is total bollocks.
How does someone take and complete a class in data structures in one week?
https://medium.freecodecamp.com/how...5 -
For any webDev in here, is there any open source tools for web data extraction? i've seen imacros and UiPath, maybe you use other tools.5
-
Am I the only one that doesn't think purely data-oriented programming is a particularly good idea?
I mean we're throwing out all the principles that have been established over the last 20 years of OOP like encapsulation and implementation hiding. And you can say what you want about OOP and yes it's not perfect, but there are things that work quite well. Implementation hiding is a perfect example of something that I don't think I just want to give up.
DOP feels like going back to programming C in the 80's with fully procedural functions and completely open structs.
Am I just going mad?6 -
My typical user interaction:
Me: "But we need to pull the data from the source and we don't have access to it"
User: "Make it work"
Me: "I want to fucking die." -
AngularJs:
Two main Controllers (main layout, sub page) and two directives with controllers. Controllers and directives have two-way data binding. All of them use $watch, $broadcast, $on.
BRAINFUCK OF MY LIFE. DO NOT COMBINE WATCH WITH TWO-WAY DATA BINDING. -
I don't even really know where to start, so I figure I'll just throw this out there and see where it goes.
My daughter is disabled. She's in sports and dance, but it's taken my wife and I years to find out about the organizations she's now in, and that's mostly through word of mouth. Other families have told us because they've had the years of experience that we didn't. And now we're passing the information on to other less experienced families. And that's a problem that everyone we've talked to agrees upon: there's really no good way of discovering what organizations are out there, and what they can help with.
There exist some sites out there like https://challengedathletes.org/reso... which are really just lists of sites, but really nothing more to indicate that this group has wheelchair basketball, that group has adaptive ballet, that kind of thing. So I'm thinking, what if I built a site that provided an index. Searchable, faceted, like Algolia or AWS Cloudsearch. That part I can do. But how would I go about gathering the information? Could I somehow scrape it? If so, how do I organize it? Do I crowdsource by petitioning /r/disability, the Facebook support groups my family belongs to, and other places across the interwebs?
I can design the data model. I can build the webapp. I can make it fast and pretty and easy to use. But how do I get the data?2 -
Cyber threats are the top concern of C levels. In actuality companies unintentionally expose way too much data. It's ridiculous what some make public.
-
I once had a colleague ranting about my variable naming because it went out of bounds on his IDE's printmargin. To please him i wrote minified code while pair programming
-
I want to become a data scientist and am now making an Android app to collect data from people. Am I doing this right? Idk wtf I'm doing anymore x(1
-
I have no idea how to make custom images so i keep a txt file for “apt-get install“ or “yum install“
-
Every time you give me a CSV to import, why is it arranged differently to the last one, missing info that is required for the point of the thing I'm importing it into, and I have to spend 2 hours going through it with a text editor and even a hex editor? Your data entry is about as clean as my arse after a particularly spicy burrito.2
-
"Like ... phenomena united by Einstein's formula E = mc², procedure and data are to some extent two different ways of viewing the same thing."
-
I hate pl-sql and data warehousing. For this project we're extracting from source tables using a generic method equal for every student, changing the data and then copying to a table for analytics.
Everyone's project is fine. Mine occupies 90mb and exceeds the quota already. Delivery due in 2 days... So much for that cs grad. FML. -
This is why you keep production data separate -- and out of the hands of developers: http://businessinsider.com/uber-emp...3
-
Looks like the EU is about to do another healthy push towards data privacy. What do you guys think? Is this the real deal, or is there something hidden underneath?
https://politico.eu/article/... -
How possible is it to have a decentralised internet?
Because currently we have an almost centralised net... Where the major players are Google, Amazon, Alibaba and the likes acting as data holders.
This really bothers me and it's fair to say that the original dream of an internet for the people, by the people, is long gone.
Can we foresee a p2p in place of this monopolitic centralised internet?4 -
So - I basicly have free data on facebook and messenger traffic. Is there a way I could possibly tunnel all my other traffic through facebook which would kind of give me unlimited data?1
-
Question to you all, do you really think you own your computer or system/data when almost all sites/services out there state very clearly in there ELUA(Fuck yes ours) that they might use your data how they feel fit, now this does not stop with websites, Mac, Windows and some Linux Distros also do this.
I for one stop thinking that I own data but I just change a few bits to make it look different these days, everything on your computer is not yours, we its and hardware, read the ELUA/TOS many hold the right to recall, revoke and so on use of the items to the point you paid for it they will take it back.
Items now sending keylogs, data usage and apps usage data to MS, Apple, some big linux distro, and YES this happens don't fool yourself Apple and MS both admit this happen and both US and UK now requesting these companies to let the have full access to this data, if it was not there they wouldn't want it.
This wont stop me from messing with code and loving tech but do you really feel you own anything anymore?
I don't :P7 -
Basically any idea without any monetizing strategy whatsoever or just the idea of "selling data". What data and to whom?!
-
“My whatever isnt working“
“Was there an error message“
“Yes“
“What was it?“
“I dont know I dismissed it“
FML1 -
I've started looking into stuffs like GraphQL and Linked Data (though I've used Micro Data before on websites) today and while fiddling with stuff, I found this handy tool:
https://search.google.com/structure...
I'm trying to create JSON-LD data and it's really helpful to have something validate my test data 🙂 -
Anyone got any good resources or advise regarding data visualization and finding relations between data programmaticly?6
-
Any suggestions on android data recovery ??
The device is not rooted and there weren't any backups.
I have already tested different paid (cracked) software on another device for testing purpose but none of them work.
Send Help!!7 -
Listening to podcasts on programming and development, and one on data science peaked my interest. Any data scientists out there willing to share what you're actually doing with data science?1
-
I just landed a job in data science, and I've been asked by my employer about the hardware specs of the machine that I'm going to use. What do you guys suggest? I don't want to be a financial burden, but I also want something that wouldn't require frequent upgrades.1
-
Today I got my plan upgraded for free to unlimited data it's a dream come true and between 12am and 12pm I used 8GB hahaha
-
I got to create the data platform with Azure Data Factory. I am new to data platform.
Any advise on what to look out for?
Could you guy please tell me if you know any good use case I can look at or any obvious pitfall which drain all the credit and so on?
I just a vague idea of what Azure data factory can do.4 -
Have opted for Big Data and analytics this sem as Dept. elective. Can't understand anything in the lectures(as usual). Any suggestions how to start learning?(books, tutorials, courses, etc.)1
-
Mass notification vendors lack of understanding that to create value for clients they must turn raw data into information into knowledge into wisdom. Shoveling oceans of raw data at us does not impress us.
-
Alright, I need your help! (Im going to so fucking regret this...) My external backup HDD is corrupt, the EaseUS Trial (piece of fucking garbage tool) can detect all the data, but im not going to pay 50-80 bucks for this (fucking piece of shit) tool...
What do you use for data recovery?
Or should I just torrent (Hate me, but im not going to pay for a tool im going to use ONE time) some other (not so piece of shit) tool?5 -
Is there a community about infrastructures? or data warehousing? Trying to find solutions for current projects, but don't have anyone for asking questions.
-
I'm trynna buid a new pc for data related works. I already have i7 8700k processor with decent cooler in Asrock z370 extreme 4 MoBo and 16 gb ram. I cant decide between RX 5700XT and RTX 2080 Super.
Please help. Your valuable opinion is highly appreciated.7 -
Hi,
So I have been using colab for the past 2 years. I liked how without any setup you can use kernels with GPU and TPU with some configuration.
But recently I can't train any model. It always goes runtime error, runtime disconnected, not to mention they have limited their total hours of usage for a day.
I know you are providing everything for free but this is just annoying. I dont mind if google wants to start a subscription plan for colab...its much better for fast prototyping than getting a cloud server from google or aws or anything of such sorts.
I have been trying to train a model with only 3 gigs of data and I cant complete the model, once I change the tab it shows Runtime Disconnected. DAMN it.
Sadly, I am trying not to use colab from now on.
But yeah I am frustrated with colab and their services.3 -
Really need help to upskill as a data engineer. Are there any free sample databases data out there with practice questions to upskill as one? I wanna learn database design, data lake and data warehousing skills... I don't know if I'm asking the right questions but if I'm not making sense, please help me out!
-
So my hosting service recently informed me of a personal information leak due to a data feed that “accidently“ went public. I'm lost for words.1
-
I'm lost here 😑! Got a new job and I supposed to analyze/fix/update/ the communication softwares/hardwares internally. Data security is insanely important and everything should be inexpensive 😑. Any suggestion what I can use as softwares and communication tools?7
Top Tags