wesm / pandas2

Design documents and code for the pandas 2.0 effort.
https://pandas-dev.github.io/pandas2/
306 stars 41 forks source link

high performance io #38

Open jreback opened 7 years ago

jreback commented 7 years ago

examine approach & integrations for the IO subsystems. pay attention to copies, memory mapping, and parallelization. let this be a master issue, with specific discussions in separate issues as needed.

in-line support parallel read / write (utilize dask)