dlt-hub / verified-sources

Contribute to dlt verified sources 🔥
https://dlthub.com/docs/walkthroughs/add-a-verified-source
Apache License 2.0
68 stars 48 forks source link

allows for delayed table reflection, column selection and buffer control in sql_database #351

Closed rudolfix closed 7 months ago

rudolfix commented 7 months ago

Tell us what you do here

Relevant issue

Improvements to sql_database

  1. reflect tables at runtime - best option for Airflow
  2. table adapter callback - ie. to select columns to replicate
  3. control buffer sizes in SqlAlchemy