dandi / dandisets

735 Dandisets, 812.2 TB total. DataLad super-dataset of all Dandisets from https://github.com/dandisets
10 stars 0 forks source link

populate* -- use `annex copy --from ... --to ` #325

Closed yarikoptic closed 1 year ago

yarikoptic commented 1 year ago

instead of tandem of get and move --to as we do now.

Joey has implemented it https://git-annex.branchable.com/todo/copy_with_both_--to_and_--from_/

I have upgraded git-annex-standalone systemwide on drogon, so if we are ready to deploy before getting fresh version in conda-forge - we just need to uninstall it from dandisets conda env:

(dandisets) dandi@drogon:~$ which git-annex
/home/dandi/miniconda3/envs/dandisets/bin/git-annex
(dandisets) dandi@drogon:~$ git annex version
git-annex version: 10.20220927-geb4a544
jwodder commented 1 year ago

@yarikoptic I'm a bit reluctant to implement this right away, as the version of git-annex in Homebrew (which is what I use) is still on 10.20221212, so it'd lead to difficulties with testing the code on my machine.

yarikoptic commented 1 year ago

ok, let's mark blocked for now

yarikoptic commented 1 year ago

just curious: https://formulae.brew.sh/formula/git-annex says that there is also HEAD version. Does it mean brew would build from current git HEAD of git-annex?

jwodder commented 1 year ago

@yarikoptic I'm not sure, but given that the upgrade to the latest git-annex in Homebrew is held back by a build error, I'm not sure building from HEAD would succeed.

yarikoptic commented 1 year ago

new annex is in brew now: https://formulae.brew.sh/formula/git-annex

jwodder commented 1 year ago

@yarikoptic That's good, but now the tests are failing with a combination of https://github.com/dandi/dandi-archive/issues/1494 and (locally for me, at least) https://github.com/datalad/datalad/issues/7286.