search

unity-sds / unity-sps

The Unity SDS Processing Service facilitates large-scale data processing for scientific workflows.
Apache License 2.0
2 stars 2 forks source link

Create test to deploy, execute and undeploy the CWL DAG #131

Open LucaCinquini opened 4 days ago

LucaCinquini commented 4 days ago

Add a test to the unity-sps-ogc-processes-api repository that:

o Registers this DAG: https://github.com/unity-sds/unity-sps/blob/develop/airflow/dags/cwl_dag.py

o Execute a DAG run with the default parameters (for now):

DEFAULT_CWL_WORKFLOW = ( "https://raw.githubusercontent.com/unity-sds/unity-sps-workflows/main/demos/echo_message.cwl" ) DEFAULT_CWL_ARGUMENTS = json.dumps({"message": "Hello Unity"})

o Waits for the DAG run to finish, checks success status

o Unregisters the DAG

Later we will update the test to use non-custom parameters, such as:

cwl_arguments = "json.dumps({"message": "Bye Bye Unity"})

LucaCinquini commented 4 days ago

See this test for the Echo Process as an example:

https://github.com/unity-sds/unity-sps-ogc-processes-api/blob/develop/unity-test/test_main.py

(we could even replace that test with our more specific test for the CWL DAG).