Would Arrow's csv reader speed things up

moj-analytical-services / pydbtools

Python version of dbtools

10 stars 2 forks source link

Closed RobinL closed 3 years ago

RobinL commented 3 years ago

It's parallelised - here's an example of it running 10x faster than pandas: https://youtu.be/fyj4FyH3XdU?t=1449

isichei commented 3 years ago

released in v3.0.0