search

datalad / datalad-osf

DataLad extension to interface with the Open Science Framework
Other
14 stars 12 forks source link

Failed to obtain OSF node handle #161

Open OleBialas opened 2 years ago

OleBialas commented 2 years ago

I have created a GitHub sibling for my data set using OSF as storage following your tutorial Creating the siblings and pushing the data worked as described and didn't yield any error messages. However when I install the data set from GitHub and download the data using:

datalad install https://github.com/OleBialas/hivemind.git
cd hivemind
datalad get *

The download fails for a number of files (see error message below). What's weird is that this behavior seems to depend on the file names. There are 20 files for every subject named '_run01.mat' to '_run20.mat' and the download always fails for files 01 and 11 (I verified that the original files are not corrupted).

I have reproduced this error on two computers. One is my local machine using the latest Ubuntu with the datalad apt package (0.15.5-1) and the pip package for datalad-osf (0.2.3.1) . The other is a server using red hat Linux, where I installed datalad using conda (datalad 0.17.2, datalad-osf 0.2.3.1)

get(error): data/preprocessed/oldman/sub01/sub01_run11.mat (file) ['MD5E-s23314264--e4f63a8e6cd680c6105ef3b9d8270b11.mat'
'MD5E-s23314264--e4f63a8e6cd680c6105ef3b9d8270b11.mat'
'MD5E-s23314264--e4f63a8e6cd680c6105ef3b9d8270b11.mat'
Failed to obtain OSF node handle: Response has status code 410 not (200,)
Failed to obtain OSF node handle: Response has status code 410 not (200,)
Failed to obtain OSF node handle: Response has status code 410 not (200,)]
get(error): data/preprocessed/oldman/sub02/sub02_run01.mat (file) ['MD5E-s23785304--209635dbea1d9abb50445b93bc6f19c1.mat'
'MD5E-s23785304--209635dbea1d9abb50445b93bc6f19c1.mat'
'MD5E-s23785304--209635dbea1d9abb50445b93bc6f19c1.mat'
Failed to obtain OSF node handle: Response has status code 410 not (200,)
Failed to obtain OSF node handle: Response has status code 410 not (200,)
Failed to obtain OSF node handle: Response has status code 410 not (200,)]
get(error): data/preprocessed/oldman/sub02/sub02_run11.mat (file) ['MD5E-s23501656--a896f0d9654420c2b9c20de3c5ecabb4.mat'
'MD5E-s23501656--a896f0d9654420c2b9c20de3c5ecabb4.mat'
'MD5E-s23501656--a896f0d9654420c2b9c20de3c5ecabb4.mat'
Failed to obtain OSF node handle: Response has status code 410 not (200,)
Failed to obtain OSF node handle: Response has status code 410 not (200,)
Failed to obtain OSF node handle: Response has status code 410 not (200,)]
mih commented 1 year ago

Can it be that the special remote implementation fails to properly authenticate? Wrong token? The error reporting may hide this. You could trying running with DATALAD_LOG_LEVEL=8 to see the chatter of git annex with the remote. That should reveal the problem.