sul-dlss / libsys-airflow

Airflow DAGS for migrating and managing ILS data into FOLIO along with other LibSys workflows
Apache License 2.0
5 stars 0 forks source link

add_bw_relationships DAG failing silently #1447

Open ahafele opened 1 day ago

ahafele commented 1 day ago

The most recent example is a DAG run that fails on the add_bw_recordtask but no email is generated so the user doesn't know what happened - in this case they alerted us because no summary email was generated.

https://sul-libsys-airflow-prod.stanford.edu/dags/add_bw_relationships/grid?run_id=manual__2024-11-19T21%3A46%3A51.433639%2B00%3A00&execution_date=2024-11-19+21%3A46%3A51.433639%2B00%3A00&tab=graph&dag_run_id=manual__2024-11-19T21%3A46%3A51.433639%2B00%3A00&task_id=add_bw_record

ahafele commented 1 day ago

I'm also not sure why this one is failing and there is no log for clues. I was able to add it manually through the UI.

shelleydoljack commented 1 day ago

The XCOM return_value for the init_bw_relationships task is:

[{'part_holdings_hrid': 'ah9178281_1', 'principal_barcode': 36105120127761}, {'part_holdings_hrid': 'ah9177890_1', 'principal_barcode': 36105120127761}]

But the next task, add_bw_record, is looking for barcode = row["principle_barcode"]. Not sure how principle_barcode got turned into principal_barcode. I think maybe the init_bw_relationships task is just using the header of the csv file uploaded?

jermnelson commented 1 day ago

Yes, the column headers come from the uploaded csv file.