search

simonw / datasette

An open source multi-tool for exploring and publishing data
https://datasette.io
Apache License 2.0
9.39k stars 668 forks source link

Support for duckdb #2226

Open ahuang11 opened 8 months ago

ahuang11 commented 8 months ago

I was experimenting with the CLI and wanted to do: datasette nino_ml.csv

Then I realized because it's not an SQLite database, it doesn't work. However, if duckdb is incorporated, I believe it could work.

CharlesNepote commented 7 months ago

Is your need to support opening csv in datasette? You can give a try to this shell script: csv2datasette. No need to support duckdb.

b-luu commented 1 month ago

:+1:

I agree that there's a clear alignment between what datasette and what duckdb are trying to facilitate: access to data for analytics!!

While I understand that datasette might have started development before duckdb (at least before it has become any popular), I'd go as far as to say that there should be a port of datasette to duckdb (instead of sqllite) as that newer engine was made specifically for analytical workloads (column oriented and so on...) plus it actually comes with a lot of pretty useful features baked-in that would make some of the datasette plugins, specific to sqllite, redundant (and not need to be ported at all, hence reducing the project area :+1: )