NASA-IMPACT / veda-data-airflow

Airflow implementation of ingest pipeline for VEDA STAC data
Other
7 stars 4 forks source link

Add docs and values to run Airflow locally #186

Open ividito opened 2 months ago

ividito commented 2 months ago

Summary:

Docs on getting Airflow set up using Kubernetes in Docker (KinD) to host a local cluster. This can enable local development without relying on MWAA environments, and can be more extensible than the mwaa-local-runner. This can also work for developing SM2A DAGs, while we prepare to migrate to that architecture.