Pandas Parquet not shown ("loading data" forever)

turbotimon commented 9 months ago

Problem: When I save a pandas.DataFrame with df.to_parquet (using pyarrow as backend), it can not be opened with DataPreview:

DataPreview is empty and showing "Loading data.." in the footer forever
It does not matter how big the dataframe is, also very small ones are not loaded
I tried it with suffix .parquet as well as .arrow

Console Log:

> window.WebComponentsReady

 data viewer initialized!

> document.readystatechange complete

 data.view:complete!

> loadDataInfo()

 data url: file:///home/test.parquet
 data table: 

> restoreConfig(
{})

>

Any recommendation how to fix?

BTW: Really like the extension!

kzeitz commented 7 months ago

Parquet viewing doesn't work on Windows or mac.

turbotimon commented 7 months ago

but I'm using Linux (NixOS 23.11) and it's not working

D3SL commented 3 months ago

@kzeitz that would be something pretty important to note in the extension page.

turbotimon commented 3 months ago

meanwhile, for anyone looking for a vscode extension that handles parquet well, i can recommend Data Wrangler

RandomFractals / vscode-data-preview

Pandas Parquet not shown ("loading data" forever) #338