Hacker News new | past | comments | ask | show | jobs | submit login

Serializing is very fast, and ingesting JSON as a stream is trivial when it's newline delineated. No one emits a giant array of json log objects, they emit a stream of newline delineated json.

You almost certainly also have it in memory more than twice since you're copying a buffer out to IO.

If you care about record size use protobuf, compression, backend parsers, etc.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: