search

sul-dlss / FOLIO-Project-Stanford

Task management for Stanford’s analysis of FOLIO.
2 stars 0 forks source link

Reporting - Load email counts not accurate #456

Closed ahafele closed 1 year ago

ahafele commented 1 year ago

The Load Report email is sometimes not reflecting the same counts as the FOLIO load report page.

User testing indicates that as-is, this report is not useful and would prefer just a link back to the FOLIO report. bib record(s) read from MARC file. should remain and is useful.

Example:

Load for Casalini emailed this report:

Filename digital-theatre-plus-all-usa-from-2023-01-2023-05.mrc - https://folio-stage.stanford.edu/data-import/job-summary/d8f2f928-5127-4dba-8007-4860aedb686a

247 bib record(s) read from MARC file.

12 SRS records created

0 SRS records updated

0 SRS records discarded

0 SRS errors

12 Instance records created

0 Instance records updated

100 Instance records discarded

47 Instance errors

FOLIO Data Import Report shows:

Screen Shot 2023-06-12 at 9.12.38 AM.png

justinlittman commented 1 year ago

I suspect that we are declaring victory (and grabbing the stats) on data import before it is completed.

mjgiarlo commented 1 year ago

Like @justinlittman says, I suspect our current practice of determining a data import is done---by detecting non-zero numbers in the job summary---is flawed. We should do another round of checking the Folio API documentation, or ask around on Slack to come up with a better strategy.