psychoinformatics-de / studyforrest-data

DataLad superdataset of all studyforrest.org project dataset components
https://studyforrest.org
8 stars 2 forks source link

Configure autoenabled Gin special remotes #58

Closed adswa closed 2 years ago

adswa commented 3 years ago

https://github.com/datalad-handbook/book/pull/753 highlighted a faulty siblings configuration that would fail to retrieve annexed data when applied. As this config was "envisioned" during the hackathon, I feared we could have applied to the studyforrest datasets. I did not find a faulty special remote configuration, but I also didn't find any special remote pointing to the sibling datasets on Gin. We should configure and enable them, in order to have a data source independent from the datapub server of FZJ.

adswa commented 2 years ago

In a fresh clone of this repository, I fail to obtain data that should be co-hosted on Gin when the HDF cloud of datapub is done:

❱ datalad get -n aggregate_fmri_timeseries 
[INFO   ] scanning for unlocked files (this may take some time)                 
[INFO   ] Remote origin not usable by git-annex; setting annex-ignore           
[INFO   ] [INFO] Fetching 'http://studyforrest.ds.inm7.de/ria-layout-version' 
[INFO   ] Failed to establish a new session 1 times. Last exception was: ConnectionError(HTTPConnectionPool(host='studyforrest.ds.inm7.de', port=80): Max retries exceeded with url: /ria-layout-version (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f4e8987b700>: Failed to establish a new connection: [Errno -2] Name or service not known'))) 
[INFO   ] Reset branch 'master' to 2ccaa115 (from 9f0f805d) to avoid a detached HEAD 
install(ok): /tmp/studyforrest-data/derivative/aggregate_fmri_timeseries (dataset) [Installed subdataset in order to get /tmp/studyforrest-data/derivative/aggregate_fmri_timeseries]
datalad get -n aggregate_fmri_timeseries  10.64s user 3.20s system 6% cpu 3:29.38 total
(handbook2) adina@muninn in /tmp/studyforrest-data/derivative on git:master
❱ cd aggregate_fmri_timeseries
(handbook2) adina@muninn in /tmp/studyforrest-data/derivative/aggregate_fmri_timeseries on git:master
❱ datalad get sub-10/atlases/bold3Tp2/shen_fconn_atlas_150.nii.gz 
get(error): sub-10/atlases/bold3Tp2/shen_fconn_atlas_150.nii.gz (file) [Remote psydata not usable by git-annex; setting annex-ignore]