Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I download profiles I'm interested in of course. Not everything. 70 profiles with 75000 tweets take 5GB for JSON + images + linked pages content + 60GB for videos.

I didn't optimize for space at all, twitter's json is quite wasteful.



Consider applying for YC's Winter 2027 batch! Applications are open till November 2.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: