Hacker News new | past | comments | ask | show | jobs | submit login

How does this compare to Pandas?



Pandas uses the Python csv module under the hood. Most of the code in the read_csv method is used to get the data from the csv file and load it into data frames.


Are you sure? Wes McKinney rewrote the Pandas CSV parser way back in late 2012 because the batteries-included version was slow and memory-hungry. Did Python upstream his version later on, or replace it with something faster (I'd be surprised if they did either, but I'd be curious to know)


It's configurable. The default parser is written in C, but it's possible to use a parser based on the csv module if you needs things like separators specified by a regex.


This project appears to have a dependency on pandas.

https://github.com/alan-turing-institute/CleverCSV/blob/mast...


That dependency is merely a wrapper to allow CleverCSV to load data directly into a Pandas data frame. It doesn't require pandas just for loading csv data.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: