search

dandi / dandisets

735 Dandisets, 812.2 TB total. DataLad super-dataset of all Dandisets from https://github.com/dandisets
10 stars 0 forks source link

populate*: move pushing of git-annex from cron job script to populate-* #318

Closed yarikoptic closed 1 year ago

yarikoptic commented 1 year ago

ATM we have 

(base) dandi@drogon:/mnt/backup/dandi/dandizarrs$ grep push_git /mnt/backup/dandi/dandisets/tools/backups2datalad-populate-*cron
/mnt/backup/dandi/dandisets/tools/backups2datalad-populate-assets-cron:foreach_push_gitannex 1
/mnt/backup/dandi/dandisets/tools/backups2datalad-populate-zarrs-cron:foreach_push_gitannex 2

which makes it call push within each dandiset or dandizarr even if there where no population done due to #317. So we better have that push done directly in populate commands after finishing populating any dandiset or dandizarr and if no population was done -- no push should be done