The ophys_processing dag runs the nway_cell_matching and cell_classifier_inference dags , but currently does not track whether those completed successfully. This PR adds a task call to check whether they've completed.
Generalize wait_for_decrosstalk_to_finish to support any dag/workflow step
Testing
Added new tests that test wait_for_dag_to_finish. Also added a test that tests that all dags can load successfully.
Other
needed to install deepinterpolation in Dockerfile since the test_dags_load imports it, and because it now imports it, renamed Dockerfile_no_deepinterpolation -> Dockerfile.
Updated argschema version since had a conflict with airflow
The
ophys_processingdag runs thenway_cell_matchingandcell_classifier_inferencedags , but currently does not track whether those completed successfully. This PR adds a task call to check whether they've completed.wait_for_decrosstalk_to_finishto support any dag/workflow stepTesting
Added new tests that test
wait_for_dag_to_finish. Also added a test that tests that all dags can load successfully.Other
Dockerfilesince thetest_dags_loadimports it, and because it now imports it, renamedDockerfile_no_deepinterpolation->Dockerfile.