cfahlgren1 / hf-data-explorer

Chrome Extension for exploring Hugging Face datasets 🔎
https://chromewebstore.google.com/detail/hugging-face-datasets-exp/algkmpgdgbindfpddilldlogcbhpkhhd
23 stars 1 forks source link

Set Datset Splits as Views in DuckDB #5

Closed cfahlgren1 closed 1 week ago

cfahlgren1 commented 1 week ago

We want to have the given dataset splits to be accessible in the chrome extension duckdb to be able to query.

We can use the parquet endpoint on the datasets server.

Using this endpoint we can: