rilldata / rill

Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code.
https://www.rilldata.com
Apache License 2.0
1.73k stars 117 forks source link

model executor for postgres and mysql to duckdb #6083

Open k-anshul opened 1 week ago

k-anshul commented 1 week ago

subtask for https://github.com/rilldata/rill-private-issues/issues/854

Sample model yaml that ingests from postgres.

connector: postgres
sql: SELECT * FROM students {{ if incremental }}
database_url: "postgresql://postgres:postgres@localhost:5432/postgres"

output:
  connector: duckdb

Backward incompatible change

  1. The MySQL duckdb extension does not support URI type dsn so users will need to submit dsn in key=value form. Have raised this issue with duckDB.
  2. Will update docs once sources are fully removed.