Epic: Data Explorer "headless" mode using duckdb-wasm for looking at CSV, Parquet files

posit-dev / positron

Positron, a next-generation data science IDE

Other

2.5k stars 77 forks source link

Epic: Data Explorer "headless" mode using duckdb-wasm for looking at CSV, Parquet files #2187

Open wesm opened 8 months ago

wesm commented 8 months ago

Breakdown to be filled out here

wesm commented 8 months ago

A few weeks ago I was able to set up duckdb-wasm and load it within Zed in https://github.com/posit-dev/positron/tree/feature/zed-duckdb

I'll use that as the starting point for implementing the data viewer features, and then later we can work on elevating this into the main application and adding file associations with Parquet and CSV files to get the "double click to view" experience

jthomasmock commented 7 months ago

@wesm - this feels like a target for Release Candidate, unless you think it would be ready by Public Beta?

wesm commented 7 months ago

I expect that it can get done a lot sooner, e.g. in time for public beta. Let's try and if I run into dragons while working on it, we can re-evaluate