Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
Search - "data collecting"
-
I had just started my new job and deleted 3 years of data that the client had spent over £450,000 collecting 😱
another developer used my PC to quickly access the clients database while I was out the room as I had sql management studio open. I went back to my PC thinking I was connected to my local database, did a few truncate tables to test my software and :0 minutes later I get a call asking why there was no data on the server!
Thank god for backups 😓7 -
1. I wish that people start taking back their device ownership. Right to repair is an extremely important thing. Like that Nexus 6P that I've recently repaired by jamming another battery into it, now it's at 110-ish% health according to AccuBattery. And it cost me.. €10 or so? All the while if I wasn't able to get in there, it would've been a €120 paperweight (and that's not even considering the €300-ish (? Someone please fill me in on that) price it retailed at back in 2015 when it was a flagship).
(edit the so many'th: according to https://express.co.uk/life-style/... the base model was apparently £449 at release, haven't been able to verify it though.. point is, a paperweight at such prices would've been quite a bummer, I mean for me it was even one given that it failed a mere few months after purchase for €120.. €40/m for a phone ain't nothing :/)
Right to repair is an extremely important thing, and the ability to do so shouldn't ever be impeded. Users should become able again to service the devices that they own.
2. I wish that people start caring about their privacy again. Google and Facebook and the likes are large companies, but at the end of the day, that's all they are. Large companies. And they're hungry for your data, not because they're selling it, rather because they're collecting it to an extent which they shouldn't. Over at DDG (https://spreadprivacy.com/duckduckg...) they explain a very much viable alternative revenue model pretty well. Additionally, there's several tools which you can use to limit the amount of data that's being collected about you. These include but are not limited to Firefox, NoScript, ad blockers (I personally use uBlock), a trustworthy VPN (ideally one of your own), and Tor.
3. I wish that software would become less inefficient. It really pains me to see that applications with functionality that could be implemented in a couple of MB at most come at a size of several hundreds of MB. 1% efficiency, even the inefficient as fuck tungsten light bulbs weren't that awful!!! Imagine what could be done with all the hardware we have available nowadays, if every piece of software would be around 80% efficient as is a common norm in electronics. Just looking at Linux which is still in many ways convoluted, modern desktops with a couple hundred MB of RAM usage? You've got it! So why can't OS's like Windows (although I have to say, huge improvements have been made there over the last few years) and browsers like Firefox and Chrome be more like that? I really don't understand.
There's several more wishes I have of course, but those are the most important ones.. hopefully I'll be able to see at least one of them come true during my life.10 -
At the end of this exercise, you will have your very own ‘bot’, capable of collecting any kind of information you want from the internet, into your own database. Sounds like a great way to get sued for Copyright infringement! Let’s get started!
https://franciskim.co/how-to-data-c...2 -
Less rant, more story.
Tl;Dr: Disney uses "Magic Bands" to track every action of every person within their parks.
So I took my family to Disney World this past summer and we got these "nifty" little things called Magic Bands. These things are little wrist devices that basically handle everything for you in the parks. It unlocks your resort room, it gets you into the parks, you pay for meals and souvenirs with it by connecting a credit card and/or your meal plan. It makes things real simple as it's like putting on your watch each day.
At first I kinda enjoyed how easy it made everything on the trip, but then as we were exiting a ride the couple in front of us noticed the digital signs had their names on them, I looked around and noticed mine too, a sign that said "have a good day $myName." It suddenly clicked. These "Magic Bands" are people trackers. Suddenly everything about the park that I had been enjoying, was part of the system they had in place using these bands as human cattle tags. The ride wait time estimations were perfect, not because of a good algorithm and estimations, but because they had actual real data telling them when a person entered the line and got off the ride.
Using a BLE scanner app I was able to see that they have hundreds of APs throughout the parks tracking every single band on every single person withing their compound. I started to think about all of the data they're collecting and the thought of it was overwhelming. The amount of assumptions they can make about people based on their actions within their parks and what that data would be worth to additional advertisers. By the end of the trip I was cynically pointing out everything to my family about the cattle tags and how much I hated wearing it and yet it was required in order to do anything.22 -
WIP - Scarlet Witch project
AKA me collecting/cleaning/processing data while someone else will get the glory 😂6 -
So I've been reading a lot about this #deletefacebook trend across devrant lately. And frankly I'm a little concerned.
As per my understanding, everyone wants to delete Facebook because they're harvesting data. Learning more about us.
While I would agree that I want my privacy. I am a little surprised at how fast this trend is picking up. People are turning a blind eye on everything else they do online just to assume they have privacy.
Let's put this Into perspective, shall we?
You are afraid of letting Facebook harvest your data yet you watch videos on YouTube which is owned by Google. You may even proceed to removing your Google account and use a stripped down version of Chromium to protect yourself from these companies yet you're using a Windows, Mac, iPhone, or Android all of which may be harvesting your data behind the scenes. Some may argue that they have stripped down their android phones but don't take into consideration that you are still using apps on your phone that may be collecting your data.
Let's say that you manage to get out of every sort of technology, you should remember that companies like Facebook also check data about you through your friends.
You use platforms like DuckduckGo assuming that they might not be collecting data about you in some way. I don't think there is anyway for you to prove that these privacy companies don't collect our data.
I don't know why everyone seems to be interested in this trend. I absolutely don't see a point in it. If anything, things I see are super relevant to me.15 -
I worked for over 13 hours yesterday on super-urgent projects. I got so much done it's insane.
Projects:
1) the printer auto-configuration script.
2) changing Stripe from test mode to live mode in production
3) website responsiveness
I finished two within five minutes and pushed to both QA and Production. actually urgent, actually necessary. Easy change.
The printer auto-configure script was honestly fun to write, if very involved. However, the APIs I needed to call to fetch data, create a printer client, etc... none of them were tested, and they were _all_ broken in at least two ways. The CTO (api guy in my previous rant) was slow at fixing them, so getting the APIs working took literally four hours. One of them (test print) still doesn't work.
Responsiveness... this was my first time making a website responsive. Ever. Also, one of the pages I needed to style was very complicated (nested fixed-aspect-ratio + flexbox); I ended up duplicating the markup and hacking the styling together just to make it work. The code is horrible. But! "Friday's the day! it's going live and we're pushing traffic to it!" So, I invested a lot of time and energy into making it ready and as pretty as I could, and finally got it working. That page alone took me two hours.
The site and the printer script (and obv the Stripe change as well) absolutely needed to be done by this morning. Super important.
well.
1) Auto-configure script. Ostensibly we would have an intern come in and configure the printers. However, we have no printers that need configuring, so she did marketing instead. :/ Also, the docs Epson sent us only work for the T88V printer (we have exactly one, which we happened to set up and connect to). They do not work for the T88VI printers, which is what we ordered. and all we'll ever be ordering. So. :/ I'll need to rewrite a large chunk of my code to make this work. Joy :/
2) Stripe Live mode. Nobody even seemed to notice that we were collecting info in Test mode, or that I fixed it. so. um. :/
3) Responsiveness.
Well. That deadline is actually next Wednesday. The marketing won't even start until then, and I haven't even been given the final changes yet (like come on). Also! I asked for a QA review last night before I'd push it to production. One person glanced at it. Nobody else cared. Nobody else cared enough to look in the morning, either, so it's still on QA. Super-important deadline indeed. :/
Honestly?
I feel like Alice (from Dilbert) after she worked frantically on urgent projects that ended up just being cancelled. (That one where Wally smells that lovely buttery-popcorn scent of unnecessary work.)
I worked 13 hours yesterday.
for nothing.
fucking. hell.undefined fuck off we urgently don't need this yet! unnecessary work unsung heroine i'm starting to feel like dark terra.7 -
Can someone explain to me why the fuck I should even care about the fact, that some companies collect, use and sell my data? I'm not famous, I'm not a politician and I'm not a criminal, I think most of us aren't and won't ever be. We aren't important. So what is this whole bullshittery all about? I seriously don't get it and I find it somewhat weird that especially tech guys and IT "experts" in the media constantly just make up these overly creepy scenarios about big unsafe data collecting companies "stealing" your "private" information. Welcome to the internet, now get the fuck over it or just don't be online. It's your choice, not their's.
I honestly think, some of these "security" companies and "experts" are just making this whole thing bigger than it actually is, because it's a damn good selling point. You can tell people that your app is safe and they'll believe you and buy your shit app because they don't understand and don't care what "safe" or "unsafe" means in this context. They just want to be secure against these "evil monster" companies. The same companies, which you portrayed them as "evil" and "unfair" and "mean" and "unrepentant" for over a decade now.
Just stop it now. All your crappy new "secure" messenger apps have failed awesomely. Delete your life now, please. This isn't about net neutrality or safety on the internet. This is all about you, permanently exaggerating about security and permanently training people to be introverted paranoid egoistic shit people so that they buy your elitist bullshit software.
Sorry for my low english skills, but please stop to exist, thank you.65 -
I know xiaomi, you must be collecting a lot of personal data but this just sounds wrong on so many levels5
-
In case anyone missed it, you probably shouldn't be using tiktok. That said, anyone surprised by this behavior is likely generally unaware of how monetization works on social media so carry on.
https://boredpanda.com/tik-tok-reve...9 -
So... GDPR.
And the deadline.
And I have no idea what to do.
What does it mean for one-man indie projects? Data protection officers? Companies? Controllers? Processors? EU employees? Argh.
Look, please, EU. Not everyone can afford to hire an entire team for this, when their current team is literally one person.
Yes, the GDPR is probably a step in the right direction, but I think I'll just stop collecting the data altogether.
(All data I collect is just user settings stored in a database, nothing more.)
Can someone point me in the right direction?8 -
Thanks everyone for giving me enough ++ to get my very own stress ball, also a special thanks zuckABird. If it wasn't for your data collecting madness i would of missed out. Ha3
-
This is a reminder for the people that keep saying ApPle CarEs FOr My priVacY BeCausE thEy stoPed 3rD PartY aPps fRoM cOllEcTiNg mY dAta29
-
Just discovered a major bug in a frontend app of ours that might have been collecting wrong data in a form for months already :)
That is what happens when you put a back end Dev to do front end and back end while demanding rework every fucking 2 days for 9 months straight.4 -
An actual anonymous web browser that doesn't collect location info, search history, etc. It also blocks any website you use from collecting data on you.6
-
Bot spends 30 minutes collecting data
I forgot to add a W to the file open call in python
Data gone.
Fuck.2 -
This is what happened today in our dayli:
Lead: We need to profile our software
Me: You can use the chrome devtools as remote profiler, even on prod, or make HAR files for later inspection.
Lead: Yeah but no that’s just collecting data on every tick, we need something like “has been called x times”
Me: Yeah but you can filt -
Lead: Yeah no, so back when I wrote code in Delphi...
Me: *oh god no not this again*
Lead: ... We could have clicked a button in our IDE and it would wrap the function call with the API call to profile that function ...
Me, to the secret dev group in slack: doesn’t a simple method decorator and node performance api help with that?
The people in the group: We had this topic last Friday all day...
Me: oh well *get’s coffee and ignores lead*3 -
So enlighten me here. Am I the only one that doesn't lose his absolute shit when it comes to privacy?
I know that some companies are collecting data, and to a certain extent, I'm fine with it as long as the trade-off is good.
I like that Google is "learning" who I am and what I like, cause now, I only see news and articles relevant to my interests, and search predictions are much better. Same with targeted Ads. On an off chance that I'm not using Adblock I like seeing products that I might like, which I otherwise probably wouldn't even know existed.
Except for Microsoft. I have no idea why, but that's where I draw the line.96 -
So I wrote my first IoT thingy...
And I'm looking for more ideas/feedback to improve it. Atm I have a raspberry pi collecting temperature, humidity and light all on different intervals (because I taught it'd be a challenge to have them all on different intervals ^.^) and I'm displaying that data on http://11601615.pxl-ea-ict.be/iot/ (I'm working on making it pretty).
So any ideas/feedback?6 -
Is it just me, or are the media / journalists once again putting a stupidly unfair pessimistic spin on that SpaceX launch?
"SpaceX rocket launches but explodes shortly into flight"
"Musk's SpaceX big rocket explodes on test flight"
"SpaceX rocket explosion: None injured or killed"
They've said time and time again, it's the first test of a massively complex rocket that's bigger than anything that's ever gone before it, and success is just defined as "getting off the launch pad" and collecting data. They did that and then some.
But instead of spreading excitement about the data, the fact it launched, that it's a world first, etc. - it's all doom and gloom, implying that the whole thing was a failure and people could have died 🙄
And people wonder why I have a low opinion of journalists.15 -
Me:- Facebook is bad , its collecting out data.
Friend:- So what let them collect our data.
le Mark Zuckerberg in the corner cashes in 💸
Friend:- As long as I get my free stuff everything's all right.
le Mark Zuckerberg comes to know he is an adopted 👶🏻 and earns more 💸 -
There was this project where a bunch a scripts had been running for three weeks analysing a bunch of fileshares. The project was in overrun and the analysis wasn't anywhere near done.
I was given complete isolation and a team of people who were instructed to do anything I needed. I had them replicate the data to as many machines as possible and I started scripting the analysis with some sample data. After half a day of collecting laptops, desktops and severs I transfered my scripts to those machines and ran the analysis in 5 hours.
I felt like I saved the project. -
While on topic of google collecting too much data, is there an chromium like android os, that doesnt spy on its user? Adroidium?13
-
In the last few days I've been collecting data for our lidar-based people detector, and it made me wonder if foot fetish is also extended to lidar scans 😂2
-
I know I am probably late to the facebook drama, but I think taking out of this all is just how genius and evil all those collector companies are.
I would have probably never thought of collecting data off of mechanical turks and quick jobbers, but they did not only think of it, they deployed their system across multiple jobs, scanning more and more data in from all those connected logins, for less than a dollar per profile, which generates atleast 300 profiles on average.
The real question is why is it allowed for a third party app to actually access all that? even if there's a permission for that, why would such exist?
I really can't see why any application would need access to likes, shares, all friends, all their profiles etc. -
I know you pals know much more than me about privacy. I have these questions to you all:
- can google still know trends about me if I only use google docs and google drive to store files I share with other people and rarely update it? Let’s say I don’t use google search or any other google service ON REGULAR BASIS
- does chromium actually works as the measure to get rid of google tracking if I don’t want to use Firefox?
- how safe is apple (miss me with that Apple hate)? How bad is the fact that I let apple store my regularly updated health information and I use iPhone?
I’m not talking about triple letters here (FBI, CIA, etc), I’m only talking about collecting and selling data across companies12 -
I hate the current state of internet based service providers. They are collecting so much data, it's scary and borderline stalking.
A simple search on Netflix changes ads shown by Google. I watch a lot of Japanese/Korean drama and now my ads are in Japanese. What the actual fuck.
I run windows 10 on my main rig because of steam and windows only games. One day I was searching for filezilla in windows search. Since it is now handled by the same UI as cortana, it searched it on the web too. So now I have ads related to ftp hosting in Japanese.
Sometimes I feel like just formatting my system and install debian on it. But those games man. May be I can live without them.
Can we bring back the internet from 2008. It was so much better back then.12 -
My phone has a useless Google Discover page on home screen that I can't use without singing in with Google and agreeing to them collecting data. 😐
So now I have a useless page on my home screen. (Really, somebody needs to make a layering over app for this shit that just gets my preferred feed and fill it here to makes use of this space. )10 -
For my Thesis
Hello devs on the internet,
I’m currently collecting data for my thesis. As my thesis is about freelancers I was hoping to interview a couple of people here who used to have a regular job and transitioned to freelancing. Interviews will be over email so it hopefully won’t take up a lot of time.
As for people who wouldn’t be available for interviews, could you help me out by answering a survey? 😁
For interviews could you email me at uzair.hayat@benilde.edu.ph
For surveys you can fill it out here https://goo.gl/forms/...
This message has not been approved by Dfox and I hope it won’t be removed haha2 -
I figured I would share my Capstone from this semester with a community that might be interested. An eclipse plugin that was developed in our lab is able to implicitly track developer eye gazes as they work in an IDE (eclipse in this case). Before I began work on it, source code, bug reports, and stack overflow documents could be tracked with all of the data on said documents being extracted. For example, if source code is being tracked, everything from the file name and class/method name down to statement types are collected. The tracking isn't on still images. Since it's within an IDE, you can open multiple files, scroll, and modify -- all while tracking is collecting accurate data based on the (x, y) gaze coordinate and the handler assigned to the type of document/file being viewed.
My job was to extend this functionality to track gazes on UML class diagram documents. This means I had to gather data at the highest level: the class/connection being looked at, down to the lowest level: members/methods, their types and containing classes.
Being new to Java's EMF, GEF, and eclipse plugin development, I had a bit of a learning curve. Anyways here is the poster of the functionality I added. 🙃
Not much of a rant haha. -
So I have question about my resume.
During my college time, I have done two projects related to politics:
One is to analyze the bias of media. What I did is scrape news covers for Trump and Hillary during election year and get sentiment analysis. The result is not surprising that among NY Times, NBC, Fox, Eashington Post, and CNN, Fox news is clearly favoring Trump, since Fox news is a republican news site.
The other project I did was to analyze the speech complexity and sentiment of the election. One of the observation we made was that Hillary and Trump are almost at the same level regarding speech complexity. However, Trump has a more positive sentiment in the speech, which is true consider how much he loves to say make America great again.
Now the question is, when I gave my advisor my resume, she said that I'd better not put those two projects on my resume since they are related to politics.
But, I am applying for a data science master degree. Seriously, I was just collecting the data and the data speaks for himself, why should I take those projects off my resume? I'm very proud of those projects I did as a matter of fact.
So here is the question. Shall I take off those two projects on my resume because they were political or I should leave it thereawarreally need some professional views. Please.1 -
It is with great sorrow I am announcing that an Apple Watch can catch fire while on your wrist. I bashed Fitbit very hard for this when they were giving people burn scars for life. Collecting and selling data is one thing, but mutilating bodies because of negligence and wanting to save a buck on manufacturing is a whole another thing. It seems like Apple is not much different.
I am struggling with body dysmorphia, and I told you out loud that if a Fitbit device gave me a burn scar for life, I would've probably committed suicide. I still stand by these words. My body integrity is a big deal to me. Having a scar due to my own negligence, like mishandling a knife, is one thing, but the concept itself that some fucking hustle culture startup can mutilate my body is another thing. It scares me.
I am considering to abandon any kind of wearable electronics altogether. The cost of failure is just too high. I'm probably going to get a mechanical Timex or a Seiko.20 -
I run a small internal dashboard for my company. One of the big parts of this workflow is collecting data from various sources, so I can start using it. I collect it all to sql db so its in one place.
What is this called? Should this be a different job role, not the developers?8 -
I know some sites are tracking and collecting a lot of data for advertising. But this is fucking insane... 200!!!! for marketing? For real? Holy shit!
Fuck off already...
(A shitty Danish newspaper - can't even remember why I visited it)2 -
Got stuck programming the accountability system for an entire State on my own because the IT shop basically refused to do any work. No help testing, no help debugging, no help with collecting and clarifying business rules, barely any help getting access to the data, and then after I had programmed the entire thing they paid a consulting company about 4xs what I was getting for them to port it to SQL and they still haven't gotten it right yet. Nothing like knowing that any mistakes in your code could cost multiple people their jobs to add some additional stress to the situation. It was actually the first time I ever experienced any physical symptoms from stress; and that includes the time when my convoy got attacked with a roadside bomb in Iraq.
-
Been developing a website for a few months for a group of people who started a company in their spare time. Basically, everyone puts in about 5 hours a week. The two founders spent a year planning the site, creating mockups and collecting data. Site has user login, 5 main sections that all require custom programming to do what they need it to do.
After a month, the one dude is getting pissy with me because I can't get their site up any faster. I agreed to 5 hours a week, in my spare time for equity to a project that has no clear monetization plan. Sometimes my main job and paying clients eat even that time up.
To date, I've only got about 30 hours of actual dev time, and 15 hours of meetings. The first launch is in sight, but the site is a monster and has more phases to come.1 -
But if a private question but for whoever wants to share, how much did your first job after graduation pay? I know it depends on the country or state ofc so let me know from where to. (Not collecting data for programmers starting salaries >.> I swear >.> )9