Ranter
Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
Comments
-
maybe this?
https://cloud.google.com/bigquery
BigQuery - Google Cloud
Or have a look at some apache projects like Lucene or Solr
https://projects.apache.org/project...
Apache Projects Directory - The Apache ...
and of course
https://hadoop.apache.org/
Apache Hadoop -
none of these have user friendly GUY where everything works just out of the box.
Im thinking personal usage, not business usage and pay 300usd a month and spent 1 week to set it up -
@pmso don't have time. I need a ready made solution, Im 100% positive that it should exist
-
pmso4174y@zemaitis
I have my data classified by
Professional and Personal
Professional->Study and Clients
Study->Backend,DBs,Frontend,Frameworks,Languages, etc
In each client, I have folders with accesses, tech docs, funcional docs, etc
In personal, I have folders for all themes I'm interested.
When I'm searching for something, I have the notion where it is. And even when I dont know, I can use grep.
I have almost 100GB of random docs and I can find anything I need.
A good system isn't made in one day, it's made along the time.
Google wasn't good in day 1. It was perfected/trained along the years. -
@zemaitis could you please give us more info on what type of data, how big? is it local on your machine or is it over a network? on linux, windows, mac?
-
@heyheni Imagine 1000 articles like in wikipedia. And i want to be able to search across them fast.
-
@zemaitis if local use GREP Global Regular Expression (regex)
if online have a look at the british GCHQ Intelligence services github. They open sourced their data analysis tool. It has a gui too. It's called Gaffer.
Otherwise it's really just Solr and Elastic search as far as i know. As you need an indexer which crawles the content and makes it searchable.
But maybe someone else knows something.
Related Rants
I am looking some tool to systemize large amounts of data and then be able to search across it fast. Something like my personal google+wikipedia in one. Can you guys recommend me something?
rant
question