Hacker News new | past | comments | ask | show | jobs | submit login

Gzip did help, but not as much as parquet. I don’t remember the exact sizes but I think parquet was was 3GB->20MB and gzip was like 3GB->180MB or something.

Also gzip was an extra step of unzip then read.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: