bin/get oai returns different data than airflow

sul-dlss / dlme-airflow

This is a new repository to capture the work related to the DLME ETL Pipeline and establish airflow

Apache License 2.0

1 stars 0 forks source link

bin/get oai returns different data than airflow #436

Closed jacobthill closed 2 weeks ago

jacobthill commented 1 year ago

The id field returned from bin/get is an array. The id field returned from airflow is a string. This didn't cause issue with csv data because of the way that data gets parsed in traject, but extract_json expects fails e.g. extract_json('.id') will not work on an array.