-
Note: account for Initial selection and ongoing (separate DAG?), should include option for date range configuration
Selection Criteria:
Initial
- All libraries, ~~excluding Lane~~
- New Bib records
-…
-
As we develop the workflow feature, the current job cancellation policy - designed for linear dependencies - stops all non-terminal tasks immediately. This approach may not suit the complexity of DAG …
-
https://github.com/dmrd/cljs-flow?tab=readme-ov-file
https://github.com/ryrobes/rvbbit?tab=readme-ov-file
awb99 updated
1 month ago
-
When we re-run failed digital_bookplate_979 dag runs (using the airflow UI by clearing the tasks), we need to somehow trigger the poll_for_digital_bookplate_979s_email dag with the dag run ID so that …
-
#### Description
Using the CLI parameter `--scenarios` results in broken DAGs due to incorrect conversion of the parameter into `egon-data.configuration.yaml`. This causes the following error:
###…
-
**
-
Test Transfer DAG Endpoint to be used in github ingestion automation: https://github.com/NASA-IMPACT/veda-data/issues/180
Example from event bridge: https://github.com/NASA-IMPACT/veda-data-airflow/b…
-
In late October we discovered an issue with the boundwith app adding admin notes that was causing the DAGs to fail (mostly silently). I thought we had fixed the issue but I'm still seeing that most of…
-
The most recent example is a DAG run that fails on the `add_bw_record `task but no email is generated so the user doesn't know what happened - in this case they alerted us because no summary email was…
-
```
for path in Path("/usr/local/airflow/dags/yamls/").rglob('*.yaml'):
dag_factory = dagfactory.DagFactory(path)
dag_factory.generate_dags(globals())
```
Using the following code we are importin…