Ranter
Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
Comments
-
bahua128017y30 minutes of 100% ram use for a single gigabyte of data to process? Sounds like python, Java, or JavaScript. :P
-
@Jifuna
A suffix array is an array which contains all suffixes of a text in lexicographically order. For the word banana it would be:
a, ana, anana, banana, na, nana
It is used for processing and analysing data, e.g. DNA sequences. -
@bahua
No it is C++. Its just a quite complexe computation and there is a lot of room for improvements.
I don‘t want to know how long it would take in Java 😂 -
Dont use buffers, just save the piece of data you created so far to a file.
It will save your ram usage a lot.
Related Rants
I finally finished my implementation of a suffix array construction algorithm! 😄
It takes about 30 mins to process 1GB of text and uses all available RAM, but it works! 🎉
Now I can optimize it, the original algorithm is 3x faster.
rant
algorithm
saca