Ranter
Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API

From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
Comments
-
12bitfloat1070924hI don't think you'll get anywhere with existing database technologies. You'll need to write something (very non-trivial) from scratch if you want to index any significant portion of the internet
Sounds like a super interesting project though -
donkulator386724hFair enough.
You'll have to go to the US to build it though, they don't like people building stuff in Europe. -
retoor781322hI agree with 12 floating bitches. But it's an interesting project, but too big for me. I'm confident as fuck but I don't think I can pull such project off. It's not nothing.
-
retoor781310hOmg guys, made me laugh :P Especially with the here is the Molodetz link :P
Anyway, real pro's search with https://search.molodetz.nl
Who wants to build with me the European search engine?
- Rust or Go for high-performance crawling
- LLM (Mistral / Mixtral / Zephyr) for reasoning and answering
- Vector DB (Qdrant / Weaviate) for semantic memory
- Retrieval-Augmented Generation (RAG) instead of classic indexing
- Postgres / SQLite / S3 for smart buffer storage
- LLM-powered garbage filter (kill SEO sludge)
- Nightly retraining & hot-swappable models
- Minimalist frontend (SvelteKit or Next.js)
- No chatbot behavior. No endless replies. Just answers.
question