USACE / water

Access to Water Issue Tracking and Project Planning
MIT License
1 stars 1 forks source link

[DOCS]: Airflow DAG Conceptual Documentation and Diagrams #68

Open brettpalmberg opened 1 year ago

brettpalmberg commented 1 year ago

These items should live somewhere in the docsify site in https://github.com/USACE/water

adamscarberry commented 1 year ago

We should consider documentation for airflow dags as an "airflow documentation site/system". This would allow us to standardize the docs for dags and have them available to link to from another service (such as water, cumulus, etc).

Thinking about storing the dag documentation in separate markdown file for each dag that might allow for static site generation from all markdown files.

Not completely thought out yet.

image

Airflow dag can load the related markdown file to continue to display the documentation within the Airflow UI.