11
Sid4597
5y

So I joined a course for big data analysis. And they setup a lab specifically for us. Pulling us away from the usual computer labs
AND GUESS WHAT THEY DON'T EVEN BLOODY HAVE MYSQL INSTALLED. THEY'VE CHARGED ME A FORTUNE AND THEY DIDN'T EVEN CARE TO INSTALL THE BASIC SOFTWARES AND ITS ALREADY BEEN 2 WEEKS WITH THE START OF THE COURSE AND NOTHING.
F**king hate this man!!!!

Comments
  • 11
    Don't let school get in the way of your education.
  • 4
    mysql isn't that well suited for big data anyways? ¯\_(ツ)_/¯
  • 1
    Did they give you any database software?

    Can you not install your own?

    Can you not use a remote database?
    # mysql -h url-to-db.com -P 3306 -u user -p
    *****

    as @Root said, education is one thing, getting through without the resources is another.
  • 2
    @heyheni true that, but it is perfect for the basics and they're starting from the basics for those who are not from computer background and have joined the course
  • 4
    @heyheni how big?

    I doubt a lab course would be using millions of rows.

    Mysql is efficient with a few million if you structure your queries correctly.

    Beyond this though... yea you want to move on.
  • 2
    @Sid4597 if so you may want to use the more robust postgressSQL.
    https://en.m.wikipedia.org/wiki/...
  • 2
    @heyheni at a student lab scale literally any of the DBs would work. Heck you could probably just use SQLite and get done with it.
  • 1
  • 1
    @C0D4 its not only about the rows. It's also about the columns, and the amount of relationships in the meta-data.

    For example, 10 tables with about 50K rows each and about 200 columns from which 70 are multiple foreign-keys together with other constraints on different columns.

    @Sid4597 ,
    Big Data (data warehouses and data lakes) usually require a distributed computing infrastructure so you'd need either HBase (as a wide column store db) or Spark SQL/Hive (as a relational db).

    Big Data is complicated, growing, and in need of innovation. If you can manage to use school resources to learn and train in this subject you can potentially save thousands of dollars on infrastructure.
  • 0
    1. docker this shit.
    2. spinup a vm on your laptop, and install all required software.
    3. big data analysis in school usually means a datacube excel connected to a sql database behind it.
    yoh can use a access db for most of that crap.
Add Comment