Ranter
Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
Comments
-
bioDan61596yThe client is right.
The data can be stored once (you can even make a cron job to scrape on a given timeframe like once a day) and the results are triggered by an event and they are given in real time by a process that iterates, analyzes and/or filters the data.
I see no problem with that -
bioDan61596y@vocuzi the results are. the data isn't.
I suspect you are doing something with big data and AI (ML/DL) ? -
That's not real time analysis that's instant result on user click. just my two cents
-
bioDan61596y@gitpush well.. in the classic sense of a machine connected to a power generator feeding real-time data to a monitoring software, you are right. Real-time refers to the currency of the data.
but I assume @vocuzi is talking about big data analysis and a.f.a.i.k performing a simple 'click' to analyze the data can take hours, days or seconds depends on the trade-offs between cost and performance.
Therefore providing results analyzing/filtering big data can also be referred as 'real-time' in terms of getting the end-result quickly (about 5 seconds ~ totally made this number up). But that might just be a sales pitch I heard so I'm not sure, I'm not an expert in the field (yet!).
Related Rants
Client : We need real time analysis.
Me : But we can't just scrape thousands of results and process them on user's click.
Client : Don't do that, Real-time analysis is scraping it once and processing it everytime the user demands.
Me : Okay
WHAT THE FUCK !!!!!
rant
client
scraping
analytics