offline - I downloaded the entire stackoverflow DB for offline use. And it's almost 94GB - devRant

Ranter

Comments

44

grayfox

3638

6y

Filter all the "duplicate question" and the "Google that" comments and responses and it will go down to 15GB for sure
5

cleancoder

469

6y

@grayfox Yes that's true, a lot of it are actually duplicates. I download each records based on tags and each question has multiple tags. But anyway, I'm gonna improve my downloader later.
7

jonmi

65

6y

Would you mind sharing your downloader?
8

gitpush

32687

6y

How did you do that?
6

mangodb

3878

6y

Just leaving a tactical dot here .
Don't mind me.
4

pandasama

951

6y

🎲
4

Psychosadistic

639

6y

📌
3

rigobertomolina

930

6y

.
5

bjoer751

77

6y

Or you could just download the published DB dump https://archive.org/details/...

I know, not as fun as creating a spider, but you'll get more metadata than is visible.
1

HoloDreamer

6584

6y

📌
2

tacticalKimchi

858

6y

I never knew you could do this.
1

dufferz

685

6y

@pyaf do you really need vs do you really want though.. I'd love to have it too. Its a pretty invaluable resource if you are unexpectedly hit with no Internet or something.

(download All the things!)
3

cleancoder

469

6y

@irene intermittent internet
1

flocke

264

6y

@irene The documentation is way to polite, I need my daily abuse on SO or I can't work.

Related Rants

devRant © 2021 Hexical Labs LLC
Privacy Policy | Terms of Service