Support Databases other than DuckDB

uwdata / mosaic

An extensible framework for linking databases and interactive views.

https://idl.uw.edu/mosaic

Other

614 stars 35 forks source link

Support Databases other than DuckDB #399

Open domoritz opened 1 month ago

domoritz commented 1 month ago

Create new connectors, for example to Postgres, Clickhouse, or Snowflake. Identify breakage points for Mosaic’s current SQL query generation and design solutions for translating from an internal "canonical" query language to different DB dialects.

A good starting point would be to leverage multi database support in DuckDB.

weifanwu commented 1 month ago

working on this issue! and almost done!

derekperkins commented 1 month ago

We're interested in BigQuery + StarRocks adapters. Once there's an adapter pattern, we'd be happy to help contribute SQL interface translations.

MarcSkovMadsen commented 3 weeks ago

I'm interested in Azure SQL and Azure Synapse databases.

domoritz commented 3 weeks ago

https://github.com/tobymao/sqlglot could be an interesting experiment to build a rest server that proxies queries to another database. I'm sure it's still tricky because of data loading but worth a try.

weifanwu commented 3 weeks ago

Wrote documentation for how to connect (PostgreSQL, MySQL, SQLite) using DuckDB extensions:

https://github.com/uwdata/mosaic/pull/430