Commont ck table data sync & (login -> company) middle table DAG

oss-know / airflow-jobs

Apache License 2.0

6 stars 19 forks source link

Closed crystaldust closed 3 months ago

crystaldust commented 3 months ago

Add a common ck table data sync DAG which requires:
- The table should have a timestamp col to compare data of diff ck envs
- Then the util will analyze the table structure, compare with timestamp, and sync data.
Add the DAG to create login->company map middle table. Which relies on pr and profiles data from graph QL