search

galv-team / jupyterlite

JupyterLite instance with Galv example workbooks.
https://galv-team.github.io/jupyterlite/
0 stars 0 forks source link

PyArrow support #1

Open mjaquiery opened 1 month ago

mjaquiery commented 1 month ago

PyArrow is our preferred mechanism for interacting with .parquet files. Currently, this isn't available for WASM, although support is currently being developed (e.g. https://github.com/pyodide/pyodide/pull/4950).

When PyArrow is packed with pyodide by default, we should be able to close this issue just by updating the versions.

In the meantime, we'll use another library for .parquet handling, probably duckdb.

mjaquiery commented 1 month ago

Looks like duckdb's JupyterLite version is still a little off usable. So we'll wait on pyarrow to work with pyodide. Hopefully won't be too long.