It may be worth looking into the polars library as alternative to pandas it utilises lazy loading and performs faster with less memory in their benchmarks and another one. The documentation seems reasonable and many pandas operations should be the same.
Description of feature
Thank you for the suggestion @jonasscheid!
It may be worth looking into the
polars
library as alternative topandas
it utilises lazy loading and performs faster with less memory in their benchmarks and another one. The documentation seems reasonable and manypandas
operations should be the same.