Interviewing a Data Scientist

Buzzword dictionary to deal with annoying clients:

AI—regression
Big data—data
Blockchain—database
Algorithm—automated decision-making
Cloud—Internet
Crypto—cryptocurrency
Dark web—Onion service
Data science—statistics done by nonstatisticians
Disruption—competition
Viral—popular
IoT—malware-ready device

Was originally hired for 3 months.

Just finished the project 2 weeks ago, after 1.5 years.

I fucking hate data science now.

"I am still cleaning the data"
- A data scientist's equivalent of 'It's compiling'

Recipe for a Great Programmer:

Ingredients:
-Books for a computer science curriculum from a top university
-Computer
-Headphones
-Internet
-Stress ball
-Pillow
-Lighter fluid
-Food

Directions:

1. Cover computer science books with lighter fluid
2. Light books on fire
3. Use flames to cook an energy-rich meal for the thousands of hours ahead
4. Pick an IDE
5. Choose a project beyond current capabilities. Good ways to push boundaries:
- Unfamiliar domain (e.g. large scale data processing, UI programming, high performance computing, games)
- Exotic programming language
- Larger in scope than any project before
6. Shut up about your IDE
7. Attempt to build
8. Stop procrastinating on Hacker News
9. Re-attempt to build
10. Squeeze stress ball and scream into pillow as necessary to keep sanity
When stuck:
- Paste stack traces into Google
- Find appropriate mailing list to get guidance
- Realize that real learning happens when you are stuck, uncomfortable, and/or frustrated
- Seek out books, classes, or other resources AFTER you have a good understanding of your deficiencies
11. Repeat #4 to #10 for at least 10 years
12. Results guaranteed! (to the same extent static types guarantee bug-free programs)

source: nathanmarz.com

Facebook: "Our facial recognition automatically tags people in pictures."

Tesla: "Our deep learning algorithm drives cars by itself."

Andrew Ng: "I predict patients' likelihood of dying with 99% accuracy."

Google: "You know one of our algorithms is going to pass the Turing test very soon."

Wall Street: "We use satellite images to predict stock prices based how filled car parks of specific stores are."

The remaining majority of data sciencists: "We overfit linear models."

Professor essentially doing a dance to show data visualisation:
“Hey pay attention! I’m trading my dignity for your education”

A tool I built for my past company just got nominated for a European Data Science and AI award!!!

I'm over the moon that something I built is up for such an award. Be early next month before winners are announced. Oh and given I don't work there anymore, how I was told about it is a REALLY funny story .... I wasn't.

Saw a Linkedin post from my ex-manager congratulating the company and the org for great work done. He/They just forgot to mention the fact that me and another ex-employee did everything, left it practically finished and completely changed the direction of the project within the first month as their plans made no sense.

fuckers.

Look what I found!
Even my L3 cache is bigger than this!

“Those were the days😂”

Presenting my research on fraud detection with Machine Learning

Intelligence and ability cannot be measured by education.

I have a client who asked a Master in Computer Science to develop a small system, for querying product title and their code. The guy used python, vanilla js, and... Txt file for the "database". Then my client asked me to integrated this in... WordPress.

This was in 2016. And idiot as I'm, I agreed and adapted his code to use php and a database.

April this year, my client said they are still using the python system to add new products all this time, in parallel. And wanted to update the WordPress with the data.

- No problem! - I said. Just send me the SQL file.

So the Master in CS sent me a SQL coded in ANSI. I asked for the SQL again, but with a more appropriate encoding. He took 1 month to reply back, and said it would be better if I get rid of the database and just use the txt file for querying.

This is outrageous.

I really hate people who are educated but completely useless.

!rant
Yesterday i updated my LinkedIn title to Data scientist.
Today morning i got 3 phone calls for job offers.

I had to open the desktop app to write this because I could never write a rant this long on the app.

This will be a well-informed rebuttal to the "arrays start at 1 in Lua" complaint. If you have ever said or thought that, I guarantee you will learn a lot from this rant and probably enjoy it quite a bit as well.

Just a tiny bit of background information on me: I have a very intimate understanding of Lua and its c API. I have used this language for years and love it dearly.

[START RANT]

"arrays start at 1 in Lua" is factually incorrect because Lua does not have arrays. From their documentation, section 11.1 ("Arrays"), "We implement arrays in Lua simply by indexing tables with integers."

From chapter 2 of the Lua docs, we know there are only 8 types of data in Lua: nil, boolean, number, string, userdata, function, thread, and table

The only unfamiliar thing here might be userdata. "A userdatum offers a raw memory area with no predefined operations in Lua" (section 26.1). Essentially, it's for the API to interact with Lua scripts. The point is, this isn't a fancy term for array.

The misinformation comes from the table type. Let's first explore, at a low level, what an array is. An array, in programming, is a collection of data items all in a line in memory (The OS may not actually put them in a line, but they act as if they are). In most syntaxes, you access an array element similar to:

array[index]

Let's look at c, so we have some solid reference. "array" would be the name of the array, but what it really does is keep track of the starting location in memory of the array. Memory in computers acts like a number. In a very basic sense, the first sector of your RAM is memory location (referred to as an address) 0. "array" would be, for example, address 543745. This is where your data starts. Arrays can only be made up of one type, this is so that each element in that array is EXACTLY the same size. So, this is how indexing an array works. If you know where your array starts, and you know how large each element is, you can find the 6th element by starting at the start of they array and adding 6 times the size of the data in that array.

Tables are incredibly different. The elements of a table are NOT in a line in memory; they're all over the place depending on when you created them (and a lot of other things). Therefore, an array-style index is useless, because you cannot apply the above formula. In the case of a table, you need to perform a lookup: search through all of the elements in the table to find the right one. In Lua, you can do:

a = {1, 5, 9};
a["hello_world"] = "whatever";

a is a table with the length of 4 (the 4th element is "hello_world" with value "whatever"), but a[4] is nil because even though there are 4 items in the table, it looks for something "named" 4, not the 4th element of the table.

This is the difference between indexing and lookups. But you may say,

"Algo! If I do this:

a = {"first", "second", "third"};
print(a[1]);

...then "first" appears in my console!"

Yes, that's correct, in terms of computer science. Lua, because it is a nice language, makes keys in tables optional by automatically giving them an integer value key. This starts at 1. Why? Lets look at that formula for arrays again:

Given array "arr", size of data type "sz", and index "i", find the desired element ("el"):

el = arr + (sz * i)

This NEEDS to start at 0 and not 1 because otherwise, "sz" would always be added to the start address of the array and the first element would ALWAYS be skipped. But in tables, this is not the case, because tables do not have a defined data type size, and this formula is never used. This is why actual arrays are incredibly performant no matter the size, and the larger a table gets, the slower it is.

That felt good to get off my chest. Yes, Lua could start the auto-key at 0, but that might confuse people into thinking tables are arrays... well, I guess there's no avoiding that either way.

Two years ago I moved to Dublin with my wife (we met on tour while we were both working in music) as visa laws in the UK didn’t allow me to support the visa of a Russian national on a freelance artists salary.

After we came to Dublin I was playing a lot to pay rent (major rental crisis here), I play(ed) Double Bass which is a physically intensive instrument and through overworking caused a long term injury to my forearm which prevents me playing.

Luckily my wife was able to start working in Community Operations for the big tech companies here (not an amazing job and I want her to be able to stop).

Anyway, I was a bit stuck with what step to take next as my entire career had been driven by the passion to master an art that I was very committed to. It gave me joy and meaning.

I was working as hard as I could with a clear vision but no clear path available to get there, then by chance the opportunity came to study a Higher Diploma qualification in Data Science/Analysis (I have some experience handling music licensing for tech startups and an MA with components in music analysis, which I spun into a narrative). Seemed like a ‘smart’ thing to do to do pick up a ‘respectable’ qualification, if I can’t play any more.

The programme had a strong programming element and I really enjoyed that part. The heavy statistics/algebra element was difficult but as my Python programming improved, I was able to write and utilise codebase to streamline the work, and I started to pull ahead of the class. I put in more and more time to programming and studied personally far beyond the requirements of the programme (scored some of the highest academic grades I’ve ever achieved). I picked up a confident level of Bash, SQL, Cypher (Neo4j), proficiency with libraries like pandas, scikit-learn as well as R things like ggplot. I’m almost at the end of the course now and I’m currently lecturing evening classes at the university as a paid professional, teaching Graph Database theory and implementation of Neo4j using Python. I’m co-writing a thesis on Machine Learning in The Creative Process (with faculty members) to be published by the institute. My confidence in programming grew and grew and with that platform to lift me, I pulled away from the class further and further.

I felt lost for a while, but I’ve found my new passion. I feel the drive to master the craft, the desire to create, to refine and to explore.

I’m going to write a Thesis with a strong focus on programmatic implementation and then try and take a programming related position and build from there. I’m excited to become a professional in this field. It might take time and not be easy, but I’ve already mastered one craft in life to the highest levels of expertise (and tutored it for almost 10 years). I’m 30 now and no expert (yet), but am well beyond beginner. I know how to learn and self study effectively.

The future is exciting and I’ve discovered my new art! (I’m also performing live these days with ‘TidalCycles’! (Haskell pattern syntax for music performance).

Hey all! I’m new on devRant!

Guidance counselor at school: so what field do you want to go into?

Me: computer science

GC: what does that entail?

Me: programming

GC: that's like super repetitive, right? You're a smart kid don't do that

In my head: no you mf dingle-dong. That's the job that will take your job away from you in the next 5 years

Ffs, why do people think coding and entering data into Excel are the same things?

I've been fairly lucky with my bosses of late since I've progressed in my programming career. But my absolute worst boss was when I first started working in an office environment doing data entry. My boss at the time was terrible, and she was always against innovation or process improvement. She also always tried to make herself look good and taking credit for the accomplishments of others. If she screwed up it was your fault, and she was "always buried in email" so she could never respond to you for pto requests, or escalation of issues between departments. My whole family pretty much worked in various roles in the department and she fired my brother after my mother left the company for no reason, saying he was "sleeping", but I worked right next to him and he's tall and had to slouch just to comfortable see his computer screen since the same manager refused to approve work station improvements for him.

Our workflow was to receive daily spreadsheets of health care claims that we had to manually process and enter into the system. So being the lazy innovator that I am, and trying to find ways I can efficiently work, I delved into studying visual basic and programmed a few functions and tools in excel to analyze, highlight, and process some of the data since the claims on the spreadsheets always had a specific pattern. This was all before I had any formal education in computer science so the program was very basic and clunky but it tripled my efficiency. When I brought it up to my boss to spread it among the rest of our team so they could use it after a short 20 minute training, she struck it down saying any training or use of it would be a waste of resources since it was too technical and complex to be used and if I were to keep improving it or use it I would be fired. It was literally copy and paste from one spreadsheet to the other en masse and clicking a button to sort and fill in the blanks. Eventually I showed it to the director of the department when working on a large data entry project with her, and I was later offered a job as a technical analyst where I was responsible for the codebase that generated the reports for the department and specifically all the reports my old boss used where I would occasionally mess with her to get back at all the crap she gave me and my brother. Since all the reports were blind carbon copied to everyone, I would send out her reports on a delay while everyone else got them on time. It eventually got her in so much crap she had to step down as a manager. She still works in the same company that I started working at again earlier this year, and like the many careers she's ruined she eventually ruined her own within the company 😂

Dropped my youngest off at the childminder today and her husband asked me what I'm doing for a job now
.. Explained its security and data science... His reply was to ask if I can setup a printer....

I've dreamed of learning business intelligence and handling big data.

So I went to an university info event today for "MAS Data Science".

Everything's sounded great. Finding insights out of complex datasets, check! Great possibilities and salery.

Yay! 😀

Only after an hour they've explained that the main focus of this course is on leading a library, museum or an archive. 😟 huh why? WTF?

Turns out, they've relabled their librarian education course to Data science for getting peoples attention.

Hey you cocksuckers! I want my 2 hours of wasted life time back!
Fuck this "english title whitewashing"

M - Me
F - Family member

F: So you study computer science... Could you recover my Gmail login data? I don't remember my email address, password or security question. (7th request to me like that from the same person, they don't bother to write down the recovered pw)
M: I can't do it if I don't know any of the above
F: Wow, I thought you're a good student... Could you at least create a new account for me?
M: But you won't even remember the new... [gets interrupted]
F: So, are you going to talk trash or get to work? You would have already been 50% done

PLEASE I'M SO TIRED OF IT. HOW DO I DEAL WITH THESE OTHER THAN TELLING THEM WHAT I THINK ABOUT THEM. I SEEK HELP

A beautiful collage....

So today I made a mock exam of data science.

My neighbor(He is 14 I think) pitched this to me and wanted advice since he was going try to participate in the Google science fair.

Him:"A robot that gives you medical advice. You just tell it your symptoms and voila! You've got your diagnosis. No doctor required."

Me: "How are you going to decide what disease the user has?"

Him:" I'm just going to write an if-else ladder statement. I've already got some of the data from this site called WebMD. It's amazing."

Me: "Go with something simple. What you're suggesting won't work out."

He told me I didn't have "Vision".
His ditched his project last week.

Computer Science is a mysterious world of three kinds of devs, irrespective of what background/profile/language they had/worked in.

The ones at the top, who keep doing crazy shit in big companies or open-source and keep adding material to the unstoppable code flowing. These constitute 5% of the dev community.

The ones at the bottom are the newbies who try to become masters/ninjas of programming by following the shit on the internet but don't understand logic or how things work. This is like 75% of dev community on the web. If you don't agree to that percentage, you don't know the number of students and non-CS people trying to code. I can see hundreds of classmates/colleagues with no understanding of basic Javascript concepts but introducing themselves as a software developer and ruler of the Web.

The remaining 15% in the middle are the "experienced" fellows who keep building shit to get to the top 5%. They work on enterprise/commercial software until the next upgrade and while the wallets keep getting fatter, they don't actually contribute to the community.
This is the part where I want people to understand the power of a dev.

What sets apart programmers/devs from other engineers:
while everyone else is busy solving the current issues/requirements of the world, we devs are the ones who 'build'.
With a right motive, a developer can solve in-numerous problems of the society, be it education, poverty or unemployment.

An experiment by Lee to put data on the web created a world of unforeseeable opportunities.
Hope to see more of Musks and less of Zuckerbergs in the future.

I attended a data science meetup recently. There were many suits walking around the corridors because of some startup night taking place at the same time.

After some time a guy appeared infront of me, telling me he was afraid at first that this was a meetup for suits only. Until he saw all the dev and rock stickers on my notebook. He was reliefed that there was some nerd at least.

He asked what I was doing so I told him about my startup about optimization of heat generation plants jada jada. I asked him back.

He replied, "Well, I'm also part of some small startup. Among the things we develop processors and stuff. It's called Intel."

Well dude, that was nicely played. I had a lot of fun that evening.

$50,000+ Computer Science fucking diploma, yet here I am on a Sunday evening doing data entry coz there is no one else to do it!

My dream was shattered!!

I joined a new company. I graduated last 2 months before and joined as data analyst.
So I was dreaming to work on some awesome research projects and all, but it was just another dream...people here don't work on any sort of data analytics instead the data science team uses regex and all to extract things and say they are building models.
Ahh...wtf!!!
Many co-workers are good and help me, but the boss. He left all the annoying works to me and the release is in next month...
"BRUH I JUST JOINED YOUR COMPANY!!!"
Then after some days he gave me more task, when he found that one task was super easy(i mean it was just to extract things using bs4 and selenium, hardly will take an hour) to do then he took that himself and in the next meeting said he did that work and it was super difficult!!!
Data science here to senior members is just for loop!! I dont even know why I joined this firm
Ahhh!!! I want to scream!!!

So my first job is also my current one. I am a computer science student and for my course we had to do a project for an actual client. The client was a consultancy company and after working my ass off, their software development partner decided to hire me and a classmate.

The company is pretty small (we are now with the 6 of us) and the general attitude is very nice. I've only been working there for a few weeks and I feel very welcome. The work isn't too hard (mainly web development with geographic features/data).
In rough lines the stack always consists of a Java Rest API and an Angular frontend that retrieved the data from the API.
So far I have learned a ton and I am really happy that I have this opportunity. Lunch is provided and we always eat together, we crack jokes, have fun, play games in the break. Coffee machine next to my desk. I'd love to work here all my life :d

Since I'm still in school I can't go to the office every day. Instead I am at the office every Monday and on other days I try to work from school or home.

"we use machine learning to ..."
Ffs you're interviewing a developer, not pitching to a investor. We know how much machine learning you use.

**Me completing data science courses**
ACCURATE.

~RANT
I started two months ago a new role in a new company.
Together with 3 colleagues I manage a HUGE OpenStack platform (I’m talking about more than 300 customers, many petabytes of data, dozens of compute nodes 😍).

On Friday night a well-known multinational had the GREAT idea to update the software of one of the core components of the platform (Neutron).
Obviously it all went wrong and customers started to call and open tickets, so even if it was already past midnight we’ve been all called to arms.
As a workaround we had to rebuild ALL the networks, detach all the ports and reattach them to the VMs, with all the errors that came with this kind of operations, such as failing to get an internal/external IP, fail to boot etcetera.

What amuses me is the fact that the above-mentioned multinational just asked for logs with no solution (except for the above workaround) until Monday morning.

It has been a good weekend, i talked with professionals from all over the world, in various languages, and worked multi-tasking with two different computers, with a third that was used just to share my screen and VPN for the management network.

During this weekend I virtually met all the possible colleagues that I will meet in this new role, and it was pretty funny to see how they handle stress. (Badly if you ask)

I’ve been woken up at 7:30 after falling asleep at 6:45, I’ve slept 17 hours in 5 days, haven’t taken a shower in 5 days (I know, it happens, I worked from home) but it was worth it.
Not only and merely for the money (overtime work), but mainly for the job itself.
I love to handle this HUGE infrastructures for now, even if I think they have many limitations and many components could have been written better.

The best thing about this weekend was to meet a group of people from all over the country and the world that worked non-stop from Friday night until Wednesday night to solve the situation.

All of them understood me when I asked them questions, and didn’t treat me like the [insert random]science nerd that I am.

I felt like in the movies, in front of three monitors, working from the comfort of my chair, in my underwear, eating as fast as I could because I was constantly in call with someone.

Apart from that, WHAT THE FUCK WENT THROUGH YOUR HEAD TO DEPLOY AN UPDATE ON FRIDAY NIGHT, YOU FUCKING PIECE OF adorable man???

WHY COULDN’T YOU WAIT UNTIL MONDAY??? NOBODY USES THOSE SERVICES AT NIGHT APART FROM THE SCHEDULED JOBS!!!!!

I HOPE YOU’LL HAVE A LONG AND PROSPER LIFE, FULL OF JOY AND HAPPINESS

Trying to get more hardware from IT for data science be like...

Just because you can learn HTML in a day doesn’t mean that you don’t need a degree.

Did you know that your browser, HTML, CSS, Javascript, and even your operating system use linked lists, binary trees, hash tables, and other so-called “useless” data structures?

It’s important to understand the roots and fundamentals of computer science even if you won’t use that knowledge day to day.

It changes your perspective on programming once you learn what actually goes on under the hood, and makes you think twice about the impact of what you write.

It’s relatively easy to get a programming job without a degree nowadays, but it often leads to web developers claiming that degrees aren’t important to their web apps.

There is much more than just the web to computer science, and that’s something to always keep in mind.

Hope there is no Data Scientist here...

My university has impeccable data management. I needed to ssh into their Linux server for an assignment but it refused to accept my login. Which was weird because I could login to the same account on one of our websites just fine. I typed my password into a text file and then copy and pasted it into both logins. The Linux one failed but the website succeeded. After some experimentation it turns out that the Linux server only recognized my username if I typed it in all lowercase, even though when I created the account it had uppercase characters as well.

So let me walk you through the sloppiness that had to have occurred for this to happen. When I first created the account it must have ignored what I entered and just saved the username in all lowercase without communicating that to me. Then the websites that use this account must either ignore case for usernames or lowercase the user input before querying the database. Finally, the Linux server, despite knowing that all the usernames are lowercase, is case sensitive and won't recognize the username as I originally typed it in.

Can you guess what department manages the account, website and Linux server? The Department of Computer and Information Science. Incredible.

Literally anything but work with computers, I think. They ask my brother to fix anything technical in the house and ignore it when he fails. They haven't been able to watch TV in six months. When I suggest that my (well-intentioned but mostly nonverbal) sibling probably shouldn't go into development, they tell me I don't know my own job. I suspect they're convinced I do graphic design.

I write C++ applications that run physical simulations and sometimes train AI models for pattern recognition and highlighting unusual incoming files.

They suggested I go to an undergrad program for data science. I already *do* data science for money and I already have an undergrad degree. 🙄

U can forget wearing your pants but never these 3...

Agreed? 🧐

TLDR Question:
When do you consider yourself an expert at a language?

More details: there is a really cool Data Science internship opening up near me that I want so badly it physically hurts me, but it asks for expert level knowledge of python, Java, or R.

I’ve only been studying R and Java for like 3 months, and Python for about 8 months, so I’m obviously no expert. When exactly does someone reach that threshold, though? When did you realize you were an expert at a language?

Should I actually look into getting a dev job..?

*I have a high school diploma (graduated three years early)
*College dropout (3-4 months, Computer Science - Personal Reasons)
*No prior work experience.
*Good textural communication skills, poor verbal communication skills.
*Currentally unemployed. (NEET :P)

*I have extensive personal experience with Java, and Python. Some Lua. Knowledge of data generation, parsing, Linux, Windows, Terminal(cmd & bash), & Encryption(Ciphers).
*Math, but very little algebra/geometry (though, could easily improve these).
*Work best under preasure.

Remote only.

Think anyone would hire me..?

zero motivation for anything, i just want sit outside in the sun at the lake with ice cream and not in front of a screen. And not being bothered by the new vacum cleaner loud deep learning rig of the data science department in this open floor office.
I fucking forgot my noise cancling headphones. FML

Two weeks ago, I chose my modules for my Master in Data Science. This morning, I received an e-mail to tell me it was a bug, I was not accepted.
.
So what's now
.
I guess I will kill myself

Frustrated, tired and a bit lost.

I'm a "Senior PHP Backend Dev", which includes not the greatest tech stack nor the best job title, but it pays fine, and the company is awesome to work for.

I suck at writing features, but I'm great at bitching, and I easily put complex abstract concepts into usable models. So I'm also QA, tester, tech lead, database architect, whatever.

That makes writing PHP less annoying, because I create the rules, and whip devs around when they forget a return type definition or forget to handle an edge case. But I don't write a lot of code anymore, I mostly read (bad) code.

Lately I REALLY feel like doing something else... problem is that I know JS/ES6, but really dislike React/Vue and the whole crappy modern frontend toolchainchootrain of babelifyingwebpackingyarnballs. I know Python/Tensorflow/etc, but don't feel like I want to go into data science or AI. And then I'm awesome at the shit no one uses, like Haskell, Go and Rust (and worse).

I got a job offer which combines a very interesting PHP codebase with a Java infrastructure, where I could learn a lot... and I'm kind of tempted.

Problem is, everyone always shits on Java. I always made a bit of fun of Java myself. Don't even know exactly why, probably some really cruel instinct which causes kids to bully the least popular kid.

I know the basics, I've written the hello world, and a small backend app for a personal project. I know how strict and verbose it can be. I love the strictness in Haskell and Rust.... but those are both also quite terse.

Should I become a Java dev? I'm not talking about Android SDK, but an insane enterprise codebase at a life sciences corporation.

To the pro Java devs: What are the best and worst things about your job, about the weekly processes, about the toolchains? Have you ever considered other languages? Do you unconditionally love and believe in Java, or do you believe Swift, Kotlin, Scala or whatever will eventually make it completely obsolete?

Will Java hasten my decline into the cynical neckbeard I was always destined to be?

There are a lot more fun langauges, but looking at realistic demand and career value...

The joy of a complete trained model.
Onto the next task. Use the model to automatically infer handwritten figures on a bankers check/cheque.

Code never lies
Comments sometimes do

Nah!
Code lies too, especially when you train a neural network 😂😂

Women in Data Science Conference - 2019, Indore, India

Anyone else taking Harvard's CS50 via edX? It's so awesome! You get a better understanding of Computer Science and stuff. I'm loving C! It feels so close to communicating with the machine. Memory allocation fascinates me, too. Is this why it's fast? If you feel like you're lacking with the CS fundamentals although you can build apps or websites already, I recommend this. This is better than my whole years in college!

A girl takes less time in getting ready as compared to windows 10😂😂😂
#WeekendHumour
#myOriginaldontCopy😏

So I have a friend who is a scientist who recently started doing some data analysis at his company and they use R. So, being the only programmer he knows, I offered to help him.

I regret my mistake. Why on earth did the developers of R decide to NOT use programming conventions? Why are 'variables' called 'objects'? Why is each data type named differently? The fuck is with the reverse arrow assignment syntax?

Just so many questions!

When you forget to normalize or standardize your data.

101, How to get approval for your projects...
source: LinkedIn

I created a curriculum to homeschool myself way up for a MSc in AI/ML/Data Engineer for Application in Health, Automobiles, Robotics and Business Intelligence. If you are interested in joining me on this 1.5yrs trip, let me knw so I can invite you to the slack channel. University education is expensive..can't afford that now. So this would help but no certificate included.

Yesterday I met my cousins who are old enough to have kids. It was a good talk with them bringing back the old memories. One of my cousins has a barely 5 year old kid. I tried to talk to her and the conversation went like this:

Me: “hey there! Hi, how are you?”

She: “Good. What do you do?”

Me: “I am a computer science engineer. What do you wanna be when you grow up?”

She: “A scientist.”

Me: **thinking calmly, “Oh, what kind of scientist?”

She: “A Data Scientist.”

Me: **Two seconds of silence and decides to leave...

So one year ago, when I was second year in college and first year doing coding, I took this fun math class called topics in data science, don't ask why it's a math class.

Anyway for this class we needed to do a final project. At the time I teamed up with a freshman, junior and a senior. We talked about our project ideas I was having random thoughts, one of them is to look at one of the myths of wikipedia: if you keep clicking on the first link in the main paragraph, and not the prounounciation, eventually you will get to philosophy page.

The team thought it was a good idea and s o we started working.

The process is hard since noe of us knew web scraping at the time, and the senior and the junior? They basically didn't do shit so it's me and the freshman.

At the end, we had 20000 page links and tested their path to philosophy. The attached picture is a visualization of the project, and every node is a page name and every line means the page is connected.

This is the first open project and the first python project that I have ever done. Idk if it is something good enough that I can out on my resume, but definitely proud of this.

PS: if you recognize the picture, you probably know me. If you were the senior or the junior in the team, I'm not sorry for saying you didn't do shit cuz that's the truth. If you were the freshman, I am very happy to have you as a teamate.

Visual Studio (Code)

-Cross-Platform App Development
-Cloud Integration
-Extensions/Packages
-Lightweight (Installer VS2017)
-Many of Langs (C#, js, Python, F#,...)
-Data Science Tools built in
-...

Cousins came over...

Me: just compiling some python code, opens up jupyter notebook to take a look at some data science code
Little Sis: *looks at jupnb dump on cmd*
Whoa are you Hacking?
Me: yeah. I got bored of whole Hacking command typing thing so I opened up my hacker console.
*print("hello world")*
Sis:wow!
Me: you know what, typing is too tiresome, I'll connect to it with my mind
*alt-tab*
*cmatrix -b*
*sits in yoga pose*
Little Sis: Screams at the top of her lungs and runs to aunt
"DAVE IS HACKING MATRIX"

If you were a 21 year old CS graduate with no further specialization, what would you choose to pursue?
1> Data Science
2> Machine Learning
3> Web Development
4> Ethical Hacking
5> Database Management
6> Computer Networks
7> Testing and Debugging
8> Software Development

Switching to macOS was an entry to paradise.

I go to Windows only to play Call of Duty. It’s crap and always will be.

P.S no comments on Linux.

The model developer may have got it

Just changed my wallpaper to be the Tensorflow logo and added 'background in data science' to my CV.

We bother only about errors not warning

TL;DR - Girlfriend wanted to learn coding, I might have scared her off.

Today, my girlfriend said she wants to learn coding.
Me: why?
She: well, all these data science lectures are recommending Python and R.
Me: Ok. But, are you interested in coding?
She: No, but I think I have to learn.
Me: Hmm.. coding requires a clear thought process, and we should tell the computer exactly what needs to be done.
She: I think I can do that.
Me: Okay... then tell the computer to think and give a random number between 1 to 10.
She: I will use that randint function. (She has basic knowledge in C)
Me: Nope. You write your own logic to make the computer think.
She: What do you mean?
Me: If I were you... Since it is just a single digit number.. I would capture the current time and would send the last digit of milliseconds @current time.
She: Oh yeah, that's cool. Understood! I will try...
" " "
We both work in same office.. so, we meet up for lunch

" " "

I didn't ask about it, but she started,
She: Hmm, I thought about it, but I was not able to think of any solution. May be its not my cup of tea.

I felt bad for scaring her off... :(

Anyway, what are some other simple methods to generate random numbers like OTPs. I am interested in simple logics, which you have thought of..not the Genius algorithms we have in predefined libraries.

"What is Data Science?" The title of the first slide of way too many data science talks.

Corporation.
Meeting with middle level managers.
Me - data scientist, saying data science stuff, like what accuracy we have and what problems with performance we managed to solved.
Manager 1: Ok, but is this scrum?
Manager 2: No they're using kanban.
Manager 3: That's no good. We should be using DevOps, can we make it DevOps?

So yea, another great meeting I guess..

So I finally got a job where I was an intern as a Data Scientist.
PS : I am a non-computer science background guy, who made it through.

Promising the boss a 95% model accuracy when the arXiv paper says it can only reach 86% is what I call self-checkmate

Visual Basic at high-school, pascal and C and Java at University. VBA for macros on a job. html+css+js learnt o er a weekend to pass the screening for a new job, then ruby and php on that job to build internal tools. Now I am into python for data science. It has been fun.

Worked as a student in a big company. Just doing data entry and checking product data. It was a nice part time job at the same time with computer science study. After a year I asked for something else and switched to the Android Team. I said I could do a little bit of Java and wrote for another half year Unit Tests. That was the point where I really learned coding and got experienced. Would never learned so much in my study because I was lazy. Now I can call me a Android Developer. Still love the company for giving me this opportunity.

"Non-devs never call Steven Spielberg to have their TVs fixed."
But sure they MUST call a dev to update their Android, iPhone, Windows, installation of Anti-virus, data recovery, malware removal, to shortlist 20 laptops from market, ask for what printer to buy, why is there a weird animation in Android sometimes, come borrow my WiFi, have their phones and computers fixed, RIP old audio CDs (yes!), fix Bluray, fix anything electronic, repair their bike, teach them science, politics...
This While True loop never escape.

so I left uni after my PhD and joined a start up where the boss is a Cambridge grad who does coding and is like 50 years old (he never told us the true value), the CTO is very talented and another dev who quickly became my best friend and me doing data science. the 4 of us worked together like friends and the efficiency was fantastic, there's no bureaucracy bullshit or shit boss talks. We built the whole thing from scratch (okay I admit they did most of the building) and to this day, we work just has we have been.

C might be a pain to write, but holy cow does it run circles around python from a performance perspective. Easy to forget in fields like data science, where python is the default

Merry 2018 in advance.

If it aint a secret, comment w/ your new years resolution so other lazy fucks can get motivated.

Mine: a 3d game (godot), releasing my data science java libraries, building some kind of robot

Someone asked me about Ruby vs Python.

The flashbacks regarding the python vs ruby wars started to kick in man.

I always liked Ruby faaaaar more than Python. And find Rails to be a far superior alternative to Django as the web framework champion from each side and Sinatra far more enjoyable than flask as the micro framewor champion on each side goes.

But this guy is very math oriented and likes the idea of data science for which Ruby has a disadvantage in terms of available ecosystems.

You can't take my blocks and dsls from me tho. I will fight for them.

Over the last year, I’ve only started learning computer science at uni, never done it before.

I’ve done units in:
- Alg. and programming fundamentals in python
- Intro to comp sci
- alg. and data structures
- theory of computation

Guess the point of this is, “why do people code, what aspirations do you all have?”
Cause rn, I’m all about “I have no idea what I’m doing, coding just seemed cool and I wanted to try it out.” Don’t know where to go

Someone inspire me???
Here is a legit reason for you to brag about what you do and what you’re going to do 😉

So here's my problem. I've been employed at my current company for the last 12 months (next week is my 1 year anniversary) and I've never been as miserable in a development job as this.

I feel so upset and depressed about working in this company that getting out of bed and into the car to come here is soul draining. I used to spend hours in the evenings studying ways to improve my code, and was insanely passionate about the product, but all of this has been exterminated due to the following reasons.

Here's my problems with this place:

1 - Come May 2019 I'm relocating to Edinburgh, Scotland and my current workplace would not allow remote working despite working here for the past year in an office on my own with little interaction with anyone else in the company.

2 - There is zero professionalism in terms of work here, with there being no testing, no planning, no market research of ideas for revenue generation – nothing. This makes life incredibly stressful. This has led to countless situations where product A was expected, but product B was delivered (which then failed to generate revenue) as well as a huge amount of development time being wasted.

3 - I can’t work in a business that lives paycheck to paycheck. I’ve never been somewhere where the salary payment had to be delayed due to someone not paying us on time. My last paycheck was 4 days late.

4 - The management style is far too aggressive and emotion driven for me to be able to express my opinions without some sort of backlash.

5 - My opinions are usually completely smashed down and ignored, and no apology is offered when it turns out that they’re 100% correct in the coming months.

6 - I am due a substantial pay rise due to the increase of my skills, increase of experience, and the time of being in the company, and I think if the business cannot afford to pay £8 per month for email signatures, then I know it cannot afford to give me a pay rise.

7 - Despite having continuously delivered successful web development projects/tasks which have increased revenue, I never receive any form of thanks or recognition. It makes me feel like I am not cared about in this business in the slightest.

8 - The business fails to see potential and growth of its employees, and instead criticises based on past behaviour. 'Josh' (fake name) is a fine example of this. He was always slated by 'Tom' and 'Jerry' as being worthless, and lazy. I trained him in 2 weeks to perform some basic web development tasks using HTML, CSS, Git and SCSS, and he immediately saw his value outside of this company and left achieving a 5k pay rise during. He now works in an environment where he is constantly challenged and has reviews with his line manager monthly to praise him on his excellent work and diverse set of skills. This is not rocket science. This is how you keep employees motivated and happy.

9 - People in the business with the least or zero technical understanding or experience seem to be endlessly defining technical deadlines. This will always result in things going wrong. Before our mobile app development agency agreed on the user stories, they spent DAYS going through the specification with their developers to ensure they’re not going to over promise and under deliver.

10 - The fact that the concept of ‘stealing data’ from someone else’s website by scraping it daily for the information is not something this company is afraid to do, only further bolsters the fact that I do not want to work in such an unethical, pathetic organisation.

11 - I've been told that the MD of the company heard me on the phone to an agency (as a developer, I get calls almost every week), and that if I do it again, that the MD apparently said he would dock my pay for the time that I’m on the phone. Are you serious?! In what world is it okay for the MD of a company to threaten to punish their employees for thinking about leaving?! Why not make an attempt at nurturing them and trying to find out why they’re upset, and try to retain the talent.

Now... I REALLY want to leave immediately. Hand my notice in and fly off. I'll have 4 weeks notice to find a new role, and I'll be on garden leave effective immediately, but it's scary knowing that I may not find a role.

My situation is difficult as I can't start a new role unless it's remote or a local short term contract because my moving situation in May, and as a Junior to Mid Level developer, this isn't the easiest thing to do on the planet.

I've got a few interviews lined up (one of which was a final interview which I completed on Friday) but its still scary knowing that I may not find a new role within 4 weeks.

Advice? Thoughts? Criticisms?

Love you DevRant <3

Waking up and guess the first item on my feed?
IBM research just released Snap ML framework that's supposedly 47x faster than Tensorflow. Now, i like advancements but fuck i just finished developing my Tensorflow model, and i don't want to rewrite this stuff again!

Building a Deep Learning environment on Windows is such pain in the ass.

INTERVIEW. It tells everything about the company. I recently applied for a "big" company for the position of ML Engineer. The Job description was like "someone with good knowledge of visual recognition, deep learning, advanced ML stuff, etc." I thought great, I might be a good fit. A guy called me the next day. Introduced himself as a manager of the Data Science team with 8+ years of experience. Started the talk saying "it is just an informal intro". But things escalated very quickly. Started shooting Data Science questions. He was asking questions in a very bookish way. Tells me to recite formulas (like big formulas). When I explained to him a concept, he was not understanding anything. Wanted a very bookish answer. I quickly realized I know more about ML stuff than him (not a big deal) and he is arrogant as fuck (not accepting my answers). Plus, he has no knowledge about Deep Learning. At the very end, he tells me "man, you need to clear up your fundamentals". WTH??? My fundamentals. Okay, I am not Einstein or Hinton, but I know I was answering things correctly. I have read books and research papers and blogs and all. When I don't know about things, I tell straight away. I don't cook answers. So the "interview" ended. I searched that man on LinkedIn. Got to know he teaches college students Data Science and ML. For a fee of 50,000 INR. It's a big amount!! Considering the things he teaches. You can find the same stuff (with far higher quality) free of cost (on Coursera, Udacity, YouTube, free books, what not). He is a cheater. He is making fool of college students. That is why I sometimes hate "experience". 8+ years of exp and he is such an a**hole!! BTW, I thanked God for saving me from that company. Can't imagine such an arrogant boss.

TLDR: Be vigilant during interviews. It tells a lot about the company.

Last night, after reading one of my computer science textbooks, I couldn't go to sleep because I came to the realization that computers will never be able to think like humans. Because a machine does what it's told to do. It is incapable of thinking outside of the box. What will need to happen is that parts of a human or some biological organism, essentially the squishy stuff, will need to be combined with a computer.

What I mean to say is that computers are good at answering questions in an absolute way. Essentially, you give it a problem and it will click away at it until some output pops out. Yes advanced AI exists, like Alpha Go. But again it's only doing what it was programmed to do. Looking at ways to play a game and answering for that question. In this case, playing a game of Go. I'll guarantee you, that not once did it stop to ask **why** it was playing Go. It was simply__just__ playing Go. But that's it. That's the limit. We give machines data/statistics and we let me them give us an answer based off of that data or input.

This is how I imagine intelligent machines will come about. A biological brain will be combined with a machine. The brain will be doing alot of the questions, and the machine will do a lot of the calculations. Together, they'll be able to answer hard questions. The heavy calculations will be left to the machine, and the heavy thoughts will be left to the brain.

I mean technically we're already doing that. But imagine a machine/brain computer that does not sleep, can't get sidetracked and will never procrastinate. That would be a scary machine.

Husband looking into online schools for CS. Anything data science related. He loves math (and is freaking good at it) and teaches himself R for fun.

I put 0 thought into my own schools (terrible, I know, but not likely to change any time soon). Any suggestions for good online data Science programs, with a math minor potentially?

It's for his bachelor's.

Finally finished my application to do Data Science. Fingers crossed I get it!

!rant
Looking for advice, serious advices.

I work in C.
Also, I work in Python.
I have worked for a couple of year in C++.
I have a fair knowledge of the Data Science workflow, and some experience in Machine Learning.
I have tinkered with some other languages (Java, Ruby, Go, JS among the others, nothing serious nor professional)

I'm the kind of person who needs constant problems to face in order to keep engaged, satisfied, happy. And I need to learn new stuff, or refining my knowledge constantly, or I stagnate. I believe that this is true for quite a share of people here.

I would like to spend some spare time (I seldom have) in a project. Personal projects are rarely good enough to improve one's cv, so I thought I could partecipate in some Open Source projects.

Does anyone here have some suggestion about some interesting and satisfying OSProject, or some general suggestion on the matter?

It would be so apreciated.

Being in Data Science and Mobile Development taught me :
1.Always be curious
2.Never stop learning
3.Never give up
4.Don't be afraid of Experimenting new Technologies
5.Don't always take ,Give More ,Share More!!

Do Share What your Domain taught you in the Comments 😀

Well, my country has a Degree called Bsc.CSIT which literally means Bachelors of Science Computer Science and Information Technology. I completed that degree and was employed right after I completed my degree. I have worked in two offices and no one cares what degree I have.

So I think Degree is not that necessary here in Nepal as long as you can get the job done.

Now I am about to pursue a Big Data related degree hope that is not as worthless as my current degree.

Data Science in Python is mind-blasting.

Data scientist and related devs, how do you handle large datasets?
I was given a .txt file containing +1M edges of a directed graph. I tried to analyze it with networkx, but my computer killed the process as it was eating too much CPU/memory.
I would be grateful for any advice!

Girl (trying to turn things on): people from my country are great in bed.
Guy: what data points do you have ?
*Girl walks out of the room*

So as you may know, I am job hunting. One company I found, called ruby, sounded interesting (the name helped). They were looking for data science type stuff.

I was about to apply when I got the feeling I should check the description. They were boasting about their flagship product.

Ashley Madison.

Needless to say, I burst out laughing and moved on.

What IDE do you use for python programming?

True that

what's your expirience with business intelligence / data science? Do your company has a own department for it?
If so how does it affect you?

Been working on a new project for the last couple of weeks. New client with a big name, probably lots of money for the company I work for, plus a nice bonus for myself.

But our technical referent....... Goddammit. PhD in computer science, and he probably. approved our project outline. 3 days in development, the basic features of the applications are there for him to see (yay. Agile.), and guess what? We need to change the user roles hierarchy we had agreed on. Oh, and that shouldn't be treated as extra development, it's obviously a bug! Also, these features he never talked about and never have been in the project? That's also a bug! That thing I couldn't start working on before yesterday because I was still waiting the specs from him? It should've been ready a week ago, it's a bug that it's not there! Also, he notes how he could've developes it within 40 minutes and offered to sens us the code to implement directly in our application, or he may even do so himself.... Ah, I forgot to say, he has no idea on what language we are developing the app. He said he didn't care many times so far.

But the best part? Yesterday he signales an outstanding bug: some data has been changed without anyone interacting. It was a bug! And it was costing them moneeeeey (on a dev server)! Ok, let's dig in, it may really be a bug this time, I did update the code and... Wait, what? Someone actually did update a new file? ...Oh my Anubis. HE did replace the file a few minutes before and tried to make it look like a bug! ..May as well double check. So, 15 minutes later I answer to his e-mail, saying that 4 files have been compromised by a user account with admin privileges (not mentioning I knee it was him)... And 3 minutes later he answered me. It was a message full of anger, saying (oh Lord) it was a bug! If a user can upload a new file, it's the application's fault for not blocking him (except, users ARE supposed to upload files, and admins have been requestes to be able to circumvent any kind of restriction)! Then he added how lucky I was, becausw "the issue resolved itself and the data was back, and we shouldn't waste any more yime.on thos". Let's check the logs again.... It'a true! HE UPLOADED THE ORIGINAL FILES BACK! He... He has no idea that logs do exist? A fucking PhD in computer science? He still believes no one knows it was him....... But... Why did he do that? It couldn't have been a mistake. Was he trying to troll me? Or... Or is he really that dense?

I was laughing my ass of there. But there's more! He actually phones my boss (who knew what had happened) to insult me! And to threaten not dwell on that issue anymore because "it's making them lose money". We were both speechless....

There's no way he's a PhD. Yet it's a legit piece of paper the one he has. Funny thing is, he actually manages to launch a couple of sort-of-nationally-popular webservices, and takes every opportunity to remember us how he built them from scratch and so he know what he's saying... But digging through google, you can easily find how he actually outsurced the development to Chinese companies while he "watched over their work" until he bought the code

Wait... Big ego, a decent amount of money... I'm starting to guess how he got his PhD. I also get why he's a "freelance consultant" and none of the place he worked for ever hired him again (couldn't even cover his own tracks)....

But I can't get his definition of "bug".
If it doesn't work as intended, it's a bug (ok)
If something he never communicated is not implemented, it's a bug (what.)
If development has been slowed because he failed to provide specs, it's a bug (uh?)
If he changes his own mind and wants to change a process, it's a bug it doesn't already work that way (ffs.)
If he doesn't understand or like something, it's a bug (i hopw he dies by sonic diarrhoea)

I'm just glad my boss isn't falling for him... If anything, we have enough info to accuse him of sabotage and delaying my work....

Ah, right. He also didn't get how to publish our application we needes access to the server he wantes us to deploy it on. Also, he doesn't understand why we have acces to the app's database and admin users created on the webapp don't. These are bugs (seriously his own words). Outstanding ones.

Just..... Ffs.

Also, sorry for the typos.

Learn modern Javascript, Python, data science, machine learning, to catch up and not be outdated

> be me
> studying 1.5 years liberal arts stuff and general education class at community college
> transfer to a 4 year university.
> realize I need a major
> Realize I also I wanted to 9ne day have a family.
> realize family would need money
> "struggling actor" not a great choice
> pray about what I should be doing
> get distinct impression that instead of attending the session on majors at the college of fine and performance arts to go to session with the college of Science and engineering.
> hear pitch for computer science.
> signup for introduction to programming taught with c++.
> A couple semesters down the line take 3 classes all at once Discrete Math 1, Linear Algebra, and database design and administration.
> around week 6 realize that all 3 classes revolved around sets and set logic and set math.
> realize rdbs's are "applied" set math and that Each class a little more "applied" than the former.
> Be genius at SQL and set math
> havereally smart database teacher mentored me
> get introduced to the recruiter at the career fair.
> get interviews
> get flown out for 2md interview
> get internship
> do work, and get project back under budget
> a job offer
> finish senior year
> start as a "real" developer supporting business data and analytics.
> ???
> profit.

Today:

I started iOS app dev thinking there’s good scope in the future,now I hear people saying app dev is gonna die switch to data science. Tf

I spent 2 hours on Python logging system instead of doing real data science.
Really this module feels poorly designed.

I have a course at my university about personal data and it feels more than a law course than a computer science one. I asked the teacher why do we have to be taught that subject and how would we be able to use what we learn in real life and she got triggered, telling me that with just by coding I won’t achieve anything and i have to learn more topics and if I didn’t want to be taught this subject why did i choose the university.
I just made a question you fuckin butthurt, chill the fuck out.

I need to buy a laptop to replace my 5 year old one. My work is mostly in data science. My budget is really flexible. Any suggestions?

In a mediocre job since last 4 years with just a developer designation, but we simply use Java based tools and products to do most of our job. Need to study for a change in job.

Literally every morning:
"Let me see what to focus on: JavaScript/Java/C++/Python/Data science/ML/AI/NodeJS/...." The list goes on.

Every Evening:
"I need to focus on Data Structures and Algorithms. So let me stick to Java for now."

Next Day:
Back to the same routine.

2 months have passed and I have not seriously studied or concentrated on anything :(

Depressed.

I am Graduate student of applied computer science. I am required to select my electives. Now i have to decide between Machine Learning (ML) and Data Visualization. My problem is Machine Learning is very theoretical subject and I have no background in ML in my undergrad. In data visualization, the course is more focused towards D3.js. Due to lack of basic knowledge i am having second thoughts of taking ML. However, this course will be offered in next Fall term. And i am also studying from Coursera to build my background till that time.

I know there is no question here but I need a second opinion from someone experienced. Also, please suggest any other resource that I should look into to build my background in ML.

Am I the only person here who thinks data science is awesome? 😬

How many of you guys are developers who are transitioning to data science and machine learning? 🤔

Was training a model for an hour on paid GPU after which it showed a deprecation error and crashed my Jupyter notebook.

Me:

Spending a year writing the code and designing the architecture for an insanely complex OSS project that is supposed to "save humanity".

Reality:

Still only 100 commits in and 0.1 % of the way to pre-alpha.

Painful Reality:

Turns out similar project already exists, was written by PhDs with stats/math background and has significantly more access to funding and resources.

[¬º-°]¬

Got some stickers for my kaggle data science club..😇😇😇😇😇

Am I Data Engineer or Software Development Engineer ?

I design the infrastructure for analytics data, and I build the infra entirely including an development. Except making reports out of the data.

What I'm supposed to be called ?
Data Engineer ?
Software Development Engineer ?

Definitely not an Data Scientist. Official designation given by company is Data Engineer II. But what I'm ?

Confused, someone help me please.

IEEE is full of shit! Why the fuck can't i download research papers when I have already paid for the subscription???
Fuckers, i didn't pay to view your old looking website!

We have been at a university of applied sciences today with our class.
It was kind of ok. I did expect more surprising things there. The whole building was smaller than our college (not the same as in the US). The rooms, where profs tell you things with a series of rows of seats, were dirty and pretty much used to the point that the seats are about to break easily.
I was expecting the university to be kind of the same as the universities you see in the movies lol.
It could have at least been bigger than our college and more "modern" than our school.
[...]
Anyways, let us get to the point here.
We were first in the foyer and afterwards in their main lecture hall.
We were introduced to the day's plans by a team of engaged students from different study programs and the president of the professors. Yada yada yada.
We got the full program in each room and each individual time span filled with study programs on a sheet of paper.
I did select pharmacy, media production, architecture, data science, applied computer science, computer engineering, mechanical engineering and future energies.
Pharmacy and data science were the most interesting study programs to me. I have asked one of the professors if deep learning was a topic for bachelor students, as well.
He said that that is only the usual case for people who got a promotion.
As an example he told me that yesterday he was at a conference hall with 10.000 people in which he gave a talk about deep learning. "Most of them were professors" he said. "Since this study program is new, it might change in a few years" he added to his conversation.

It is quite hard having to decide now.
Geo informatics and Aerospace Engineering did sound interesting, too.
There are a lot of things I would like to study at the same time haha.

Idk if I should just pick mechanical engineering first and add one or two after it to it. But that would take a lot of time. Geez.

The gap of data science in industry and academia is so large. As a data scientist in a large financial company, I see that people are still using traditional models such as linear regression and SVM, while people in academia keep inventing new concepts and techniques such as deep learning.

I am not saying that we should completely embrace deep learning, or stick to classic methods. But I just feel so surprised that the gap is so large...Sometimes I am even thinking whether I am doing the right "data science"...

A bunch of people who know a bunch of frameworks but lack intrinsic understanding CS, therefore bringing the degeneration of overall quality.

This ultimately leads to:

1- shitty dev jobs (the future blue-collar job, always in risk to be automated)
OR
2- super high-end dev jobs (most likely AI engineering, devops, data science)

As generations pass, this shapes out a whole new world economy.

I am studying an online data science course in python offered by Microsoft.
The instructor uses Surface book and also has a Mac book on his desk for backup because windows.
He uses chrome all the time for his explanation to run jupyter.
The point is even they know their tech is shit but still "Windows has set your default browser to edge" - this happens
¯\_(ツ)_/⁻

I'm working as an intern in a company and i have another intern that i must supervise (it like internception) .here is my daily nightmare :
- To start this intern never google something she copy paste from my code and if she got an error she send me a screenshot . Once the error message clearly said "cannot call function from array" and even that she didn't know what's the problem (she was supposed to it on array items)
-Before we started working together she spent a week complaining that a sending email function didn't work for her so the manager called me to check what's her problem. She had an antivirus that blocked request via ssl port.all i had done is open the log file and read the errors.
- She had a function should iterate over an array and for each item check a condition this is a part of what she wrote :
For ($i=0;count($categories);$i++){
if ($getrelativepath=null)
{
....etc other​ stuff she copy pasted.
Ps: the name of the function that she must call on array items is getRelativePath

- she wrote once
$response=array();
for (...){
array_push($response,$data[$i]);
return $response;}
She thought the function can iterate and return response at the same time.
- we are working on a website and she told me she doesn't know how to code Javascript and jquery (she think it's a language) and she never knew what ajax is.
- without mentioning the hundreds of empty spaces and multiple empty divs in html .
This year she'll become a computer science engineer .

Data science

Hey guys any advice/study plan for a 22 year old C++ Server developer to transition into data science ?

P.s. currently based in London

2018: Data Scientist = Stack overflow copy pasting: "I followed a 12-hour 'DS' course on Lynda!"

lm() # science

Clustering high dimensional data - SOS!

I have to cluster documents. I computed the tf*idf, but I have ~45K docs with 28K words.
I did minibatch kmeans which works alright, but everything else runs forever. I need to compare 2 clustering algorithm, so I need at least another one that works. In this life time.
Suggestions?

Story of a data scientist 😞

Spends 80% of the time trying to identify features, while the rest 20% worrying about identifying the features 😭

Today I came across a very strange thing or a coincidence(maybe).
I was working on my predictive analytics project and I had registered on Kaggle(repository for datasets) long back and was searching on how to scrape websites, as I couldn't find any relevant dataset. So, while I was searching for ways to scrape a website, suddenly after visiting a few websites, I get notifications of a new email. And it was from Kaggle with the subject line
"How to Scrape a Tidy Dataset for Analysis"
Now I don't how to feel about it. Mixed feelings! It is either a wild coincidence, or Kaggle is tracking all the pages visited by the user. The latter makes more sense. By the way, Kaggle wasn't open in any of the tabs on my browser.

!rant
Started Data Science course on big data universuty. The outcomes are heavily dependent on domain experts/stakeholders!!! Since all the answers are false positives and need to decide what make sense with the help of domain experts. And most of the Data scientists are not from programming background, they are domain experts who turned into Data scientists. Thoughts if I should continue with learning big data/data science, knowing that I have knowledge in information retrieval and search engines.

Anybody know what a good salary for a graduate developer/data science role is in Norway? Specifically Oslo.

Going to go and have an interview there in a month's time, having to teach myself some statistics and enough in the React framework in the 25 days I have, so if you have any recommendations I'd appreciate it.

When professors rely on YouTube to teach you the syllabus, you know this is our education system **

#India

Lots of good suggestions up in here.

My personal prefference:

Such as there are governing bodies indiciating how a programming language evolves and a web consortium...there should be a computer science one. That dictates fundamental approaches covering everything that belongs to this wonderful branch of science. Everything from math to differenr scientific branches all the way down to turtles. And for it to be standarized and updated. Indeed, if you want to spend your entire existence gobbling js in the form of web sites then that is fine, but you should have sufficient knowledge to branch out into more academic pursuits if required.

Also, updated tools would be better, every aspiring computer scientist shall be able to navigate through all major operating systems and programming environments regardless of their beliefs and or prefferences and schools should provide said environments in their classrooms.

Data Strucrutes and Algorithms should be a must. Software engineering principles should be a must. Calculus, Algebra and Statistics as well as Physica should be a must.
And succesfully navigating over different engineering areas should be a must.

Not to cleanse the industry. Fuck your elitist mentality. If you think that programming is a sacred art that should exclude people then I really hope you fucking disapear from existence. No, not to cleanse. But to expand the industry and maybe show people that there is more than fucking around between node modules or gemsets.

Peace pendejos

**drops your mom's fatass...i mean mic**

This happened when I was in the first semester of my study (I'm currently studying Computer Science).

Didn't understand anything, never learned to code before. My first "project" from my lecturer was to write a mini-journal together with two friends of mine (which weren't able to code either) about the link of VR use with the increase/decrease of the user's heart rate.
We didn't find any way to record the user's heart rate automatically and periodically. The deadline was getting closer but thankfully we found an android app that can be used to detect someone's heart rate with the user's finger pressed onto the camera. Sadly the app can't be used to record the data periodically (it can only show us the average heart rate). We told my lecturer (who is supossed to "guide" us here) about the problem and asked him for solutions.
He told us to "modify the .apk and connect it to a database".
At this point, we didn't even know how to make a database, let alone "modify the .apk".

In the end, we used an oximeter, recorded it, and listed the results manually. 😂

Anybody have any great tutorials about web scraping with python? The data science courses I took only covered maipulauting and visualizing data not getting it.

Hello.
I am a student of Computer Science Engineering (Bachelor of Technology). I am 3 years into this 4-year course. I am strong in Data structures and Algorithms, and passionate to add more stuff to this list.

I am really done with this University coursework, and want to explore more (specifically, want to do something that is practical, and matters). I, obviously cannot leave the Uni, but I want to make my time at home more productive. Not just to me, but everyone.

But:
1. I don't know where to start.
2. I teach myself everything, and hence, there is much difference between what I know and what people need, and I'm kind of scared of ruining/wasting other's time.

If there is someone out here who has the time out of his/her busy schedule to guide and set me on a path, please do help me. It's getting weird in my head.

Languages I know: C(took a 1-year course), Python, JavaScript [learning JAVA], Oracle, Visual Basic

Things I have done before:
* Developed a fullstack website for Indian Railways (going live in May 2019) [used Python for back end]

I have a sincere need from within to do this, and I am going to learn whatever more I need to, in order to fulfill your requirements. Please just show me WHAT and from WHERE.

Kindly do get back.

!rant

You knoe, my first insights into computer programming came out of spite. I thought windows to be garbage and wanted to blame someone other than myself for my machine constantly crashing. Thus I discovered programming and down the rabbit hole. But my interest in computer science came from videogames. Portal in particular. I found the idea of GlaDOS fascinating and thought that artificial intelligence would be something interesting to research. The web then gave me Lisp, and boy was the language different from all the other languages I went through. I remember feeling super excited when Racket, Common Lisp and eventually Clojure would help me discover many different ideas. Every time I work with reduce or maps or stuff like that in other languages I always thank languages such as Clojure for having me descipher different ways of manipulating data to get a result. To this day I feel sad whenever I find that my languages do not have the same constructs that Clojure has. I mention Clojure because it is my favorite flavor of Lisp. But one thing that always remains grest to me is firing up Emacs and plugin my code to Slime or Cider and see the repl pop up waiting for something to happen. This feeling is beautiful.

Please guys, if you have not tried it, do so! You might hate it at first or push it aside. But trust me, once you get it it will really change the way you think about programming in general. Try the great Clojure for the Brave and true, and go through the third chapter succesfully. If you do not like Lisp by them then no harm done! You would at least know that there are other options.

Now, here are some cool things:
For the standard implementation, try Common Lisp

For a more modern Scheme, try Racket or Guile

For targetting the JVM try Clojure (more akin to Common Lisp) or Kawa (scheme like)

For the python AST get Hy (pun totally intended)

For JS try Clojurescript

For emacs scripting try Emacs Lisp (has way too many disasdvantages but still relatively close to common lisp)

Honorific mention to more pure functional programming languages for Haskell, F#, Ocaml.

Also worth mentioning that Js , Ruby and Python have great functional constructs.

(println "you will not regret it!")

Learning Data Science to predict the possible ending(s) of GOT.
Hell Yeah

Training a ML model is easy. Getting high accuracy on both cross validation and test sets is a different story.

Hey DevRant!

Not really a rant but a question:
I just got accepted into a coding bootcamp. Have any of you been involved in one? How was it? What would you do to make it a better experience throughout? Any advice or suggestions?

It's full time, six months long and I start in October and I want to make sure I make the most of the experience and absorb as much as possible.

I'm super happy that the course appears to be less just learning JavaScript and more involved in the Computer Science side of things, even including bits about C/C++, distributed systems, algorithms and data structures, software design/testing, cryptography, database management, and computer architecture. It also, of course, covers tons of resume work, interview practice, and networking.

Thanks!

Come to a weekly deep learning meet up this morning 8.30AM. The event start at 10 AM.  While waiting I read news and play some game. As time near 10 o'clock I had strange feeling: The guest room so quiet, just me and 2 security guy.

Okay I think comittee that run this event a bit late because of traffc jam and I wait more. In the end the committee didn’t even show until 10.30AM. Later I found on another data science group today's event is postponed and I go home.

WHY DIDNT YOU GUYS MAKE ANNOUNCEMENT ON SLACK? YOU WASTE MY TIME WAITING 2 HOURS

Just developer things ...

Source - Kaggle Cannabis Dataset

ATTENTION PLEASE! Important announcement following:

Please check your interface implementations for correct byteorder according specification BEFORE YOU START COMPLAINING ABOUT DATA FAILURES ON EXCHANGING DATA.

Freakin hell, if I'd get some money for every byte order mismatch on testing interfaces, I'd be a be a billionaire.

And why are all those highlevel I-know-every-fucking-framework developer incapable of checking the real memory content of a datatype, and the real data content on the interface even if you tell them that their byte order is obviously wrong?
No, your system is not the centre of the universe and I don't care how you get your less-than-32bit-datatypes-are-for-assembler-usage-frameworks to change byteorder. It's not rocket science, if there's no ready-to-use-function then write those 4 lines yourself.

Next time I get to specify an interface I'll go for mixed-endian, just to make sure everybody involved knows the concepts of endianess afterwards.

My worst fight with a dev was definitely that time I tried to break the mould and build this incredibly tedious VB app to automate data handling through Excel, PowerPoint and Outlook. The other dev always said "you can do this" and "come on, it's not rocket science" and I was always like "yeah, dude, sure, but can you help me with this bit here, please, I'm so stuck on it?" He'd be all like "ofc bro, I got your back", but when it came to the actual work that needed to be done, he was all silent. Needless to say, now I have a rubber ducky to help me with my dev needs, as talking to myself felt like a nightmare. Guess that's what other people feel like when I strike up a conversation with them, too.

Let’s just face it. Once the majority of people understand, data science (machine learning on custom behaviour mostly) will be the most disgusted job in the world. Mind boggling! You get shot right between the eye by doing it.

Hi guys i need to vent with you. I live in Portugal.I graduated in computer science with 16 (0-20). While I was graduating I worked in my university programming for iot and big data fields. I have one article published in a scientific journal. I was looking for a job in my country, and I have gone to 5 interviews where they wanted to pay me about 700 maximum because they say this is my first job. The house rent is about 300 and with food and daily needs I can't have money to simple things in life. It's sad that companies don't give value to people they just think in money. It's sad that our work and knowledge is not valued...

I know it's quite soon to think about it, but: next year I'll graduate in cs and I'm still not sure about what to do after:
- I could just stop studying and start working
- study for another two years on a specialistic degree in Italy
- go take a two years master in machine learning, data science and ai in Finland

Which of these makes more sense?

"""Itty bitty frustration"""

# wannabe mode on

import sklearn
iris_dataset = sklearn.datasets.load_iris()

tl;dr
that moment was a full semester

full
I was an Electrical Engineering major taking a Data Structures class and for the first time, I understood the title computer SCIENCE. In EE, you just blueprint all day long, but you never build anything. In CS you build and blueprint at the same time.

So I have question about my resume.
During my college time, I have done two projects related to politics:
One is to analyze the bias of media. What I did is scrape news covers for Trump and Hillary during election year and get sentiment analysis. The result is not surprising that among NY Times, NBC, Fox, Eashington Post, and CNN, Fox news is clearly favoring Trump, since Fox news is a republican news site.
The other project I did was to analyze the speech complexity and sentiment of the election. One of the observation we made was that Hillary and Trump are almost at the same level regarding speech complexity. However, Trump has a more positive sentiment in the speech, which is true consider how much he loves to say make America great again.

Now the question is, when I gave my advisor my resume, she said that I'd better not put those two projects on my resume since they are related to politics.

But, I am applying for a data science master degree. Seriously, I was just collecting the data and the data speaks for himself, why should I take those projects off my resume? I'm very proud of those projects I did as a matter of fact.

So here is the question. Shall I take off those two projects on my resume because they were political or I should leave it thereawarreally need some professional views. Please.

Never underestimate the power of a misplaced static in your Java to totally fuck you over.

I was busy with my computer science project for the semester where we have to implement a Sudoku solver without backtracking by using graph theory.

So there I was writing my data structure for the grid when for some reason all the cells were initialized with the value 8.

After a whole night of debugging I was about to start over when I realized I had made my array static.

And boom, it works. WTF!!!!!!!

How many of you are completing undergraduate degrees?

Are you pursuing any special discipline? (E.g software engineering, Data science...)

Or you are grasping a bit of everything?

Why the fuck do you ask Data Structures and SQL queries for a Data Science interview?

I feel pity on those companies who evaluate people based on the above for DS position.

# Start a new job
## find out, on the first day, that the position you applied (data science)..simply doesn't exists
##find out that the environment is really stressfull and not pleasing as it was depicted during interviews
## quickly find an alternative to quit current job
#Start a third new job (3 months after quitting the first one)
##find out, on the first month, that the code quality is below zero.
###there are no unit tests.
### there is no possibility to create a unit test because the code doesnt folloe any pattern.
###there is no division between backend and frontend.
###there is no division between business logic and db in the backend.
###there is no division between frontend, business logic, and db
###find out that they deliberally built a framework to get frontend and backend togheter
###the project is built over maven, but there are no poms wellformed
###the project is approx 300k java lines....
##lose hope and start to find a new job....

When you wanna be a Data Scientist and always land into internships where you are assigned with web development...
Learnt Node, Flask, Spring frameworks across different internshis...

I work as a data engineer in my company. My senior calls himself data scientist- he is 29 years old and recently did one MOOC on data science!

I wonder when my colleagues will find out about how much he really knows.

Till then I am cleaning and arranging his data, while he sits and earns a big fat package by citing one data scientist tag to his profile!! -_-

I thought the field of Data Science was plagued with frauds, then I met "Data Science Recruiters."

Basic requirement of every Data Science college internship:

1) 2-3 years of experience... God damn it
2) Research and publications...(yeah right! in 2 years of college in which you taught me how to "work with" C on Turbo-C... I should have god damn publications... Well worked my ass on and have 2, but guess what campus internships says.. " no fucks given man", solve those damn segment tree question first then we will talk)

Its an infinite recursive while loop
FML

Old one but popped into my mind today,

during 3rd year project, when all computer science students were mixed together,

I wrote the design / implementation doc

had a lot of acronyms as it was a technical course

referenced VS IDE

Idiot on team came along and decided to expand these acronyms

IDE became Intercompany Data Exchange

I lost the plot as he submitted it before i proof read the thing!

*face palm

!rant
For a project we have to formulate political viewpoints and laws about digitalisation. It's not for a computerscience class, but for a additional class on politics. We have to formulate laws or guidlines/goals for the politicians to work towards in regards to "digitalisation" for the society/country we would like to live in.

For example stuff like "there should be net neutrality to guarantee free information and equal oportunities for all" and such stuff or "programing should be taught in school to prepare people for the economy of tomorrow" so it isn't limited to anything.

If you where a kind of king/ruler/what ever, what policy (in regard to "digitalisation") would you define and why? (Note: they doesn't have to be realistic for now. They shouldn't end in a dystopian future, but in a "better" future for all of humanity.)

What I thought of so far would be:
- Government use and promote Opensource and practice Opendata
- strong rights to privacy, you can request your data and demand it being deleted
- basic programing/IT education in school
- "reschool" program for people currently in the workforce that want to learn new things
- develope a policy on AI
- promote that Computer Science isn't just for boys but for every one
- less working hours per week due to automatisation/splitting the work among the whole population/basic income

*yes I'm lazy, thanks for doing part of my project ;)

So today in school I decided on my career choice. So I've decided on becoming a data scientist because I can still use my programming and I very much do like looking at data and researching things as well as program obviously :) so if there are any data scientists or data miners out there do you have advice?

Data scientists unite!
I am working on a face recognition solution to identify and tag different faces in real time and currently using chinese whispers algorithm for clustring. The more I think about it the more inadequate it sounds (number of faces encoded increase over time thus the complexity). I've heard about YOLO but cant really decide. Please enlighten me!

Just bombed my first quiz in Data structures & algorithms on induction. Fuck.
And the midterm is a week from today.

R or python for data science?

Why would you (not) choose R over Python for Data Science?

Hey all, can you guys recommend some great books on database theory and design. Something aimed towards intermediate towards advanced. It doesn't have to be sql, I just want to learn how to make a kick a#@ db.
Thanks!!!!!!!

So they're working on a way to store data in DNA. That means next generation computer science students have biology as a core course!

I see people’s Deep Learning project organization and library usage prowess on Github and I have fucking no clue where they learnt these ingenious tricks. All I can think of is learning from looking at other people’s GitHub. Is there a better way??

Yesterday I was so high. Today when I open my data science project notebook and I saw that I used seaborn package without importing it...😂😂😂

I'm Angularjs and .NET developer. I'm planning to learn addition skill / tool.
Options are:
1) MEAN Stack
2) React (and related)
3) ML / Data Science
4) Django

Why Mean?
Because it'd easy for me to grasp and I can easily get projects for it.

Why React?
Always curious about React, because of the hype maybe. But really wanna learn. And some gap for React developers.

Why ML/DS?
Tbh, I suck at Mathematics and Statistics. Why ML / DS just because it sound fascinating.

Why Django?
Enough with JS JS JS, what else?

Please give your suggestions :)

Ugh. So for one of my classes (Projects In Computer Science) we have to break up into groups; Around 4-6 people per group and build some software for different local companies in the city that I live in.

Well.... the company that my group chose is so damn frustrating. Essentially we are making a glorified Applicant Form system for their website (there's more to it than just that). So you would think that the company knew what sort of fields would be needed for these forms.... Well no, we are over a month into this project and still have barely began coding shit because they are so fucking slow to respond to our emails, don't pick up our calls, or put off doing absolutely anything related to our project! Our professor asked that we would have a written copy of the project requirements made and signed off by the client within the first 2 weeks of classes starting. Took them over a month to get around to that, and still even after signing off on the requirements said that they were missing key forms that we needed to account for... Its your damn fault for not telling us that. We completely wasted our time planning out the database and structuring the front-end/back-end to work for the forms they had given us, and now there's yet another one with inconsistent fields, meaning we need to rethink out most of our system to account for this data. We only have 3 months total, 1 which is already gone and practically wasted, and even still we don't have any sort of confirmation on what form fields we have to account for.

Fucking hell just spend a little bit of time for both our sake, and your own to get us the finalized forms fields and requirements for this project. Honestly at the rate things are going we probably wont be able to finish, which sucks ass since this project is perfect resume material.

Seriously this company desperately needs us to make them this program since their current system is absolute shit. They are literally getting a system that would cost upwards of $20,000 for free, yet they don't seem to care much that we probably wont be able to finish due to their faults. If we didn't have a time cap on this project I wouldn't really care, but the fact that we only have 3 months, plus school work in other classes, exams and a personal life, its making this project a lot more stressful than it needs to be.

Its not like we have a project manager either, so all the emailing and communication is being done by myself. Honest to god, all they have/had to do was sit down for 1 hour of time to decide what they all needed and we would probably have been able to finish this project.

“Train like a GAN!”

Gave me a career when I wasn't looking for one. Graduated with a mathematics and Management Science double major. Started as a data analyst and a Java architect saw something in me and gave me a shot. He was a dick at first and we had a minor squabble in which I defended myself and I thought I was done there. I later apologized and said I didn't have to because I was sticking up for myself.

I hated programming in college. Found it boring and thought I could teach myself if I wanted to. So in the real world, the problem solving and the variety of languages and software to work on opened up my eyes and allowed me to follow though my career.

For that I get a sweet paycheck, tons of opportunities and my children get to have and do things I never had the opportunity to do as a child.

I am wondering..i learnt Java, later on PHP and during my internship Clojure and during some remote projects JavaScript and now because of my AI/Data Science ambition, hv been dwelling on Python and about R...am I going crazy or just confused...what paradigm should I focus on and stay there proficiently?!🤕🤕

Deep learning and data science

Data scientist life begins when for him:
Forest becomes Random Forest and Tree becomes a Decision tree.

Alright, so I'm starting out doing some data-science, well, trying to. I'm a newbie okay, give me a break.

I can manage it relatively well with just basic Python, SciKit and NLTK. I'm looking to learn some Jupyter, can anybody recommend me some good books/tutorials on it?

I started working with Luigi, the workflow manager for a data-science project. Any input on how to test the Tasks or how does it compare to Airflow?

One of my Computer Science modules this year revolved around completing a team project, and one person in the team basically fucked it up for all of us in the last minute.

We had to create a simple task management app for a fictional company, the university did not care about how the program looked and all that mattered was if the app is functional or not. The app relied heavily on a database, so all we basically had to do was get, modify, and add data from a database. Now this person did his part of the programming, but with an outdated database model and did not even test his code as he said MySQL wasn't working on his home computer.

2 days before the final deadline is when we decided to merge everything together in the git repo (as that's when the rest of us finished our tasks), and that's when we found out none of his code worked. We then spent the next 48 hours with little sleep to try our best to fix everything, but unfortunately due to his tasks carrying a majority of the complexity of the program we couldn't fix it all in time and we ended up losing roughly 50% of the marks.

This all probably could have been avoided if one person in the team did look at his git branch properly, but this person was the programming lead of the project and didn't ask for any help at any point until the last moment when we merged everything together. Oh well though, at least I've learnt better for the next team project that I do

Fucking test, son of a bug I made you finally green. Test Driven Data Science induced RAGE.

What is your opinion about learning data science using JavaScript?
Is it better than Python?

!rant apologies

I am a third year computer science student and I'm interested to see how professionals think I stack up against grads they have worked with straight from uni.

I have spent 15 months at a web company working on bespoke solo products on LAMP stacks. I know html, css, JavaScript and its library JQuery very well (I know JavaScript is massive to be saying I know it well)

I am reasonable at PHP and MySQL. Currently I am studying node.js and building an api that mashes up data from other APIs to build a new service. I'm also working on a C# Microsoft framework bespoke website. I know git to a reasonable level - branches, merges, rollbacks and all that jazz.

I am also studying development architectures to try and be more useful.

So if you guys came across a new grad that knew HTML, css, JavaScript, JQuery, maybe angular js, PHP, basic Linux commands, MySQL, C#, dev architectures, agile methods, node.js, git and has 15 months experience working on small to medium sized solo projects would you want to hire them?

Point to note I'll probably graduate first class (80%+) from a mid range uni.

Sorry, I know this is not the place but I like this community.