mara / mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
MIT License
2.07k stars 100 forks source link

Rename `data_integration_*` tables #83

Open leo-schick opened 2 years ago

leo-schick commented 2 years ago

With version 3 the package data_integration as been renamed to mara-pipelines but the internal tables are still named data_integration_*.

I suggest to rename the tables to pipeline_* in the next major version. For example data_integration_run would then get the name pipeline_run. The data could be moved to the new tables during db migration (needs to be implemented). For people still needing the old tables one could create SQL views (CREATE VIEW data_integration_run AS SELECT * FROM pipelines_run) to still be able to acces the table with their old name.