Airflow data-aware scheduling

The examples here are used to demonstrate the data-aware scheduling feature of Airflow. The examples are described in the following Medium stories:

1. Problem with using data intervals when backfilling dataset scheduled DAGs
2. Circumventing the problem of using data intervals when backfilling dataset scheduled DAGs

Running the examples

The examples can be run with

make run

or

docker-compose up

References

1. Airflow data-aware scheduling docs
2. Medium story about Airflow data-aware scheduling with dynamic task mapping