Modin(Ray, Dask): For performance of larger dataframes, it would be cool if the summaries do not depend on pandas, but could also work with scalable implementations, such as dask. We can easily test this by generating larger dataframes. https://github.com/modin-project/modin
Modin is working on Windows compatibility with Dask, will be released somewhere this week. Just send a pull request...
sbrugman
commented
5 years ago
Modin(Ray, Dask): For performance of larger dataframes, it would be cool if the summaries do not depend on pandas, but could also work with scalable implementations, such as dask. We can easily test this by generating larger dataframes. https://github.com/modin-project/modin
Modin is working on Windows compatibility with Dask, will be released somewhere this week. Just send a pull request...