The ophys_processing dag runs the nway_cell_matching and cell_classifier_inference dags , but currently does not track whether those completed successfully. This PR adds a task call to check whether they've completed.
Generalize wait_for_decrosstalk_to_finish to support any dag/workflow step
Testing
Added new tests that test wait_for_dag_to_finish. Also added a test that tests that all dags can load successfully.
Other
needed to install deepinterpolation in Dockerfile since the test_dags_load imports it, and because it now imports it, renamed Dockerfile_no_deepinterpolation -> Dockerfile.
Updated argschema version since had a conflict with airflow
The
ophys_processing
dag runs thenway_cell_matching
andcell_classifier_inference
dags , but currently does not track whether those completed successfully. This PR adds a task call to check whether they've completed.wait_for_decrosstalk_to_finish
to support any dag/workflow stepTesting
Added new tests that test
wait_for_dag_to_finish
. Also added a test that tests that all dags can load successfully.Other
Dockerfile
since thetest_dags_load
imports it, and because it now imports it, renamedDockerfile_no_deepinterpolation
->Dockerfile
.