Executing CWL workflows with Docker containers from Airflow

unity-sds / unity-project-management

Container repo for project management (projects, epics, etc)

Apache License 2.0

0 stars 1 forks source link

Executing CWL workflows with Docker containers from Airflow #135

Closed mike-gangl closed 3 months ago

mike-gangl commented 5 months ago

Executing CWL workflows with Docker containers from Airflow

Airflow Schedule

Actions

[ ] Link to issues or list of actions to take to mitigate the risk.

Associated Objectives

[ ] Airflow Schedule

mike-gangl commented 3 months ago

DIND is working fine, we've got the correct permissions for the internall docker containers. There was a small issue with needing to increase the 'hop limit' on the EC2 instance for the DIND to be able to reach the ec2 metadata (Served via local host).