When you write a crawler to scavenge through a set of sites but only compare their 'uniqueness' through an on-startup hash map which doesnt reflect values already in DB and now you've duplicate values coz you didn't define uniqueness in DB either :v
I need to not be sleepy rn.