search

opensource-observer / oso

Measuring the impact of open source software
https://opensource.observer
Apache License 2.0
74 stars 16 forks source link

Consider DuckDB / Motherduck for frontend OLAP database #2299

Closed ryscheng closed 1 month ago

ryscheng commented 1 month ago

What is it?

Currently we use Clickhouse for both sqlmesh + frontend API.

Since we are moving to Trino for sqlmesh, we might want to consider duckdb for frontend. Hasura3 has support for it, so that shouldn't be an issue.

ryscheng commented 1 month ago

We'd have to connect duckdb to our Iceberg tables somehow as a pre-requisite

ryscheng commented 1 month ago

Filed issues #2347 and #2348 as followon work for this.