search

buda-base / drs-deposit

Harvard DRS Deposit base
1 stars 0 forks source link

Reconcile actually built with BatchBuild table #67

Closed jimk-bdrc closed 5 years ago

jimk-bdrc commented 5 years ago

Sometimes, volumes which have been built have not been updated due to intermittent failures of calls to updateBuildStatus. An empty directory is being passed in. Check make-drs-batch.sh

jimk-bdrc commented 5 years ago

Run

select d.objectid, d.IngestDate, v.label, v.builtFileCount, v.builtFileSize, bb.BuildDate from DRS d join Volumes v using(volumeId) left join BatchBuilds bb using(batchBuildId) where bb.batchBuildId is null;

You'll see about 1000 volumes which have been built but not deposited. Some of them have file sizes that seem to indicate

jimk-bdrc commented 5 years ago

See druk:~jimk/tmp/DRSReconcile. The batch builds being empty was a red herring. The DRS entries were left in because HUL didn't send us complete lists of all the objects they deleted. You can find all the objectids we requested those in Database Invalid Deposits and the HUL lists in the Production Deletion Reports I applied the standard recovery procedure (DeletionTestScript.sql)[https://github.com/BuddhistDigitalResourceCenter/drs-deposit/blob/master/database/drs/InvalidMultiVolumeDeposits/DeletionTestScript.sql] to those objectids