I'm thinking of an engine agonistic IO that would load a dataframe directly from a file and save it to a file and read it back.
I think the pyarrow implementation of the parquet is a good choice where it faithfully reproduce the complex index that we are using.
I'm thinking of an engine agonistic IO that would load a dataframe directly from a file and save it to a file and read it back. I think the pyarrow implementation of the parquet is a good choice where it faithfully reproduce the complex index that we are using.
The interface that i'm thinking of would be