hubmapconsortium / airflow-dev

Configuration, workflows, and DAGs for the development instance of Airflow on HIVE infrastructure
MIT License
1 stars 0 forks source link

airflow-dev

This repo, and the purposes outlined below, have been mostly replaced by ingest-pipeline. Currently moving relevant issues over to ingest-pipeline or other active repos.

Previous Purpose: This was used for configuration, workflows, and DAGs for the development instance of Airflow on HIVE infrastructure.

If you had a workflow you'd like to run as data is submitted to HuBMAP, make a PR here and then ...?

The details of most workflows will be in docker containers. For workflows which take intermediate formats and translate them into formats for visualization on the web, see the portal-containers repo.