search

dandi / dandisets

760 Dandisets, 817.2 TB total. DataLad super-dataset of all Dandisets from https://github.com/dandisets
10 stars 0 forks source link

error installing dandisets 000026/000108/000249/000251 #211

Closed anhknguyen96 closed 2 years ago

anhknguyen96 commented 2 years ago

Hi,

I cloned the repo 2 weeks ago using datalad install -r https://github.com/dandi/dandisets (python 3.9), all of the dandisets were cloned except for 000026/000108/000249/000251, with the corresponding errors displayed. I'm not sure what caused the errors and I'd appreciate some help. Thanks!

Screenshot from 2022-06-05 14-09-15 Screenshot from 2022-06-05 14-10-04 Screenshot from 2022-06-05 14-41-04

.

jwodder commented 2 years ago

I cannot reproduce this; cloning those modules works fine for me in a fresh Docker container. Are you still having this problem?

I suspect that this may have just been an intermittent issue on GitHub's end.

yarikoptic commented 2 years ago

confirming that install worked out, and I did get those dandisets:

$> ls -l {000026,000108,000249,000251}/dandiset.yaml 
-rw------- 1 yoh yoh 25722 Jun 21 06:28 000026/dandiset.yaml
-rw------- 1 yoh yoh  2078 Jun 21 06:27 000108/dandiset.yaml
-rw------- 1 yoh yoh  5237 Jun 21 06:28 000249/dandiset.yaml
-rw------- 1 yoh yoh  3638 Jun 21 06:28 000251/dandiset.yaml

I guess the original problems were due to some connection instabilities and/or github freaking out (not unheard of) under heavy load (after all you had done 175 clones). As datalad doesn't retry on such fails, I have filed an issue there https://github.com/datalad/datalad/issues/6770 . As there is nothing to fix in dandisets, I will close this issue.

anhknguyen96 commented 2 years ago

Hi yes, sorry for the tardy response. I datalad clone individually these dandisets and it worked, so I guess it was connection issue on my part. Thanks.