Open yarikoptic opened 3 months ago
@yarikoptic The error message seems pretty clear to me:
backups2datalad.util.UnexpectedChangeError: Dandiset 000966: Metadata for asset sub-M230804-1/sub-M230804-1_ses-20231229T155815_ecephys.nwb was changed/added but draft timestamp was not updated on server
This is the Archive's fault for not updating the Dandiset's draft version's modified
timestamp upon unembargoing. Running the backup command with --mode force
should get rid of the error.
But it is RuntimeError: Backups for 162 Dandisets failed
-- is there already so many dandisets which were unembargoed??? (very unlikely)
@yarikoptic Based on the below script, there are only 6 Dandisets that have been unembargoed (000253, 000408, 000773, 000774, 000897, and 000935).
Is the problem described in the original comment still an issue?
#!/bin/bash
set -eu -o pipefail
dandiset_root=/mnt/backup/dandi/dandisets
cd "$dandiset_root"
for ds in 0*
do
embargo_status="$(git -C "$ds" config --file .datalad/config --default OPEN --get dandi.dandiset.embargo-status)"
if [ "$embargo_status" = OPEN ] \
&& git -C "$ds" log -S EMBARGOED -n1 -- .datalad/config | grep -q .
then echo "$ds"
fi
done
@yarikoptic Ping.
blocked by #56 ATM. Please just rerun that command with --verify whenever we do not have ongoing backup process running
@yarikoptic This problem is still occurring, but seeing as it's affecting Dandisets that are still embargoed, the problem seems to be solely with Dandi Archive. I have filed https://github.com/dandi/dandi-archive/issues/2002.
After
48
I manually ran the
--mode verify
sweep and it errorred out quite loudly -- here is the trail pointing to the full logfrom which it looks like potentially unemabrgoing forgetting to reset the
modified
may be?