Add optional filter and post_harvest flags to bin/gen

sul-dlss / dlme-airflow

This is a new repository to capture the work related to the DLME ETL Pipeline and establish airflow

Apache License 2.0

1 stars 0 forks source link

Add optional filter and post_harvest flags to bin/gen #533

Open jacobthill opened 1 month ago

jacobthill commented 1 month ago

Currently bin/get only runs the harvest task which is useful in some cases but sometimes we need the data to be filtered and we need to run any post_harvest tasks.