CUB-Libraries-CTA / counter-data-loader

Loads COUNTER database from JR1 report spreadsheets
1 stars 2 forks source link

Workflow Incorrectly Treats Spreadsheets as Loaded for Errored "mysqlimport" commands #59

Open bonnland opened 1 year ago

bonnland commented 1 year ago

Description:

When running the loader workflow on just the Excel spreadsheet "tr-b3-bloomsburyeducationandchildhoodstudies-2021-0112.xlsx", the workflow fails at the mysqlimport step, but the spreadsheet is added to the report_inventory table.

This means that the spreadsheet is considered sucessfully processed, and it will be skipped on any future loader workflows, even though the data was not added to the database.

The error produced on the command line looks like this:

mysqlimport --user=******** --password=************ --delete brian_counter /Users/Shared/AmazonMirror/workingFiles/title_report_temp              /Users/Shared/AmazonMirror/workingFiles/metric_temp > mysqlimport_out.txt
mysqlimport: [Warning] Using a password on the command line interface can be insecure.
mysqlimport: Error: 1062, Duplicate entry '1' for key 'title_report_temp.PRIMARY', when using table: title_report_temp