search

18F / open-data-maker

make it easy to turn a lot of potentially large csv files into easily accessible open data
Other
200 stars 135 forks source link

Read CSVs in chunks using smarter_csv #293

Closed ultrasaurus closed 8 years ago

ultrasaurus commented 8 years ago

We should consider this PR: https://github.com/18F/open-data-maker/pull/94

pkarman commented 8 years ago

Also this: http://xjlin0.github.io/tech/2015/05/25/faster-parsing-csv-with-parallel-processing/

pkarman commented 8 years ago

295 implements this

yozlet commented 8 years ago

Ultimately implemented & merged in #297.