search

sul-dlss / dlme-airflow

This is a new repository to capture the work related to the DLME ETL Pipeline and establish airflow
Apache License 2.0
1 stars 0 forks source link

Write custom driver for Brooklyn Museum #451

Closed jacobthill closed 2 months ago

jacobthill commented 9 months ago

Brooklyn Museum requires us to harvest a set of ids first, then build urls for each record. We need a custom driver for this. Or, alternatively, we could build a pre harvest task to fetch the ids and then use the dlme_json driver.

aaron-collier commented 2 months ago

I believe this was closed in https://github.com/sul-dlss/dlme-airflow/pull/454