issues
search
oss-know
/
airflow-jobs
Apache License 2.0
6
stars
19
forks
source link
Multiple updates
#142
Closed
crystaldust
closed
1 year ago
crystaldust
commented
1 year ago
Add excludes for daily sync, since some inited repos might be deleted and we can never sync them again
kk transfer special cases: define template driectly in code instead of vars
Delete opensearch docs in nasty sync manner(a dummy polling), since the place holder document might affect ck transfer
Add opensearch request timeout(60s)
Add batching mechasium for github pull reuqest collection
Add ck data aggregation in triggered job
In triggered job, check sub tasks status, if succeeded, skip