oss-know / airflow-jobs

Apache License 2.0
6 stars 19 forks source link

Daily sync feature #128

Closed crystaldust closed 1 year ago

crystaldust commented 1 year ago

Add the feature to daily sync gits and github related indices, which will first read all the unique (owner, repo) pairs from OpenSearch in each index, then call the sync library to sync all (owner, repo)s, instead of reading them from Variables.