search

Barski-lab / cwl-airflow

Python package to extend Airflow functionality with CWL1.1 support
https://barski-lab.github.io/cwl-airflow
Apache License 2.0
185 stars 32 forks source link

API upgrade. Tested #49

Closed michael-kotliar closed 3 years ago

michael-kotliar commented 3 years ago
  1. Added API endpoint to create and trigger DAGs in the same call
  2. Moved logic from clean_dag_run.py into cwl.py so it can be reused
  3. Added --combine flag to test new API endpoint. Possible risk - can be too slow when cleaning old dag_runs, as we can't create new dag_run with the same dag_id and run_id if the previous one wasn't deleted.
  4. Added progress field in the GET /dag_runs response. Made it work much faster