Hacker News new | past | comments | ask | show | jobs | submit login

Of course you shouldn't use Pandas to analyze terabytes of data, but most people aren't analyzing terabytes of data.



That's what Spark is for. You can do petabyte-scale jobs... with DataFrames.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: