datalad-datasets / human-connectome-project-openaccess

WU-Minn HCP1200 Data: 3T/7T MR scans from young healthy adults twins and non-twin siblings (ages 22-35) [T1w, T2w, resting-state and task fMRI, high angular resolution dMRI]
https://db.humanconnectome.org/data/projects/HCP_1200
37 stars 6 forks source link

Missing file HCP1200/198047/MNINonLinear/Results/tfMRI_WM_LR/tfMRI_WM_LR.nii.gz #24

Closed adswa closed 3 years ago

adswa commented 3 years ago

Reported by Nevena. However, it is available via the connectomeDB API:

datalad download-url https://db.humanconnectome.org/data/archive/projects/HCP_1200/subjects/198047/experiments/200614_CREST/resources/200614_CREST/files/MNINonLinear/Results/tfMRI_WM_LR/tfMRI_WM_LR.nii.gz
yarikoptic commented 3 years ago

indeed seems to be not on S3 for that subject

$> datalad ls s3://hcp-openaccess/HCP_1200/198047/MNINonLinear/Results/tfMRI_WM_LR/tfMRI_WM_LR
Connecting to bucket: hcp-openaccess
[INFO   ] S3 session: Connecting to the bucket hcp-openaccess with authentication 
Bucket info:
  Versioning: S3ResponseError: 403 Forbidden
     Website: hcp-openaccess.s3-website-us-east-1.amazonaws.com
         ACL: S3ResponseError: 403 Forbidden
HCP_1200/198047/MNINonLinear/Results/tfMRI_WM_LR/tfMRI_WM_LR.L.native.func.gii         2018-08-19T19:53:13.000Z 248511335 
HCP_1200/198047/MNINonLinear/Results/tfMRI_WM_LR/tfMRI_WM_LR.R.native.func.gii         2018-08-19T19:53:13.000Z 246222464 
HCP_1200/198047/MNINonLinear/Results/tfMRI_WM_LR/tfMRI_WM_LR_Atlas.dtseries.nii        2018-08-19T19:53:13.000Z 148510648 
HCP_1200/198047/MNINonLinear/Results/tfMRI_WM_LR/tfMRI_WM_LR_Atlas_MSMAll.dtseries.nii 2018-08-19T19:53:13.000Z 148510632 
HCP_1200/198047/MNINonLinear/Results/tfMRI_WM_LR/tfMRI_WM_LR_Jacobian.nii.gz           2018-08-19T19:53:18.000Z   3134621 
HCP_1200/198047/MNINonLinear/Results/tfMRI_WM_LR/tfMRI_WM_LR_Physio_log.txt            2018-08-19T19:53:18.000Z   1386342 
HCP_1200/198047/MNINonLinear/Results/tfMRI_WM_LR/tfMRI_WM_LR_SBRef.nii.gz              2018-08-19T19:53:18.000Z    842780 
HCP_1200/198047/MNINonLinear/Results/tfMRI_WM_LR/tfMRI_WM_LR_hp200_s4_level1.fsf       2018-08-19T19:53:18.000Z    155186 

but available for another (the last one, chosen randomly):

$> datalad ls s3://hcp-openaccess/HCP_1200/996782/MNINonLinear/Results/tfMRI_WM_LR/tfMRI_WM_LR      
Connecting to bucket: hcp-openaccess
[INFO   ] S3 session: Connecting to the bucket hcp-openaccess with authentication 
Bucket info:
  Versioning: S3ResponseError: 403 Forbidden
     Website: hcp-openaccess.s3-website-us-east-1.amazonaws.com
         ACL: S3ResponseError: 403 Forbidden
HCP_1200/996782/MNINonLinear/Results/tfMRI_WM_LR/tfMRI_WM_LR.L.native.func.gii         2018-08-25T13:32:16.000Z 271686775 
HCP_1200/996782/MNINonLinear/Results/tfMRI_WM_LR/tfMRI_WM_LR.R.native.func.gii         2018-08-25T13:32:16.000Z 277086604 
HCP_1200/996782/MNINonLinear/Results/tfMRI_WM_LR/tfMRI_WM_LR.nii.gz                    2018-08-25T13:32:16.000Z 334324086 
HCP_1200/996782/MNINonLinear/Results/tfMRI_WM_LR/tfMRI_WM_LR_Atlas.dtseries.nii        2018-08-25T13:32:16.000Z 148510648 
HCP_1200/996782/MNINonLinear/Results/tfMRI_WM_LR/tfMRI_WM_LR_Atlas_MSMAll.dtseries.nii 2018-08-25T13:32:16.000Z 148510632 
HCP_1200/996782/MNINonLinear/Results/tfMRI_WM_LR/tfMRI_WM_LR_Jacobian.nii.gz           2018-08-25T13:32:20.000Z   3150886 
HCP_1200/996782/MNINonLinear/Results/tfMRI_WM_LR/tfMRI_WM_LR_Physio_log.txt            2018-08-25T13:32:20.000Z   1364319 
HCP_1200/996782/MNINonLinear/Results/tfMRI_WM_LR/tfMRI_WM_LR_SBRef.nii.gz              2018-08-25T13:32:20.000Z    837377 
HCP_1200/996782/MNINonLinear/Results/tfMRI_WM_LR/tfMRI_WM_LR_hp200_s4_level1.fsf       2018-08-25T13:32:20.000Z    155186 

IMHO worth checking with HCP folks -- seems just that was not transferred and nobody noticed

adswa commented 3 years ago

IMHO worth checking with HCP folks -- seems just that was not transferred and nobody noticed

Will do - but in the past I've added those files with download url manually. Will do that tomorrow though - we have finished our hackathon with plenty of beer, and I don't want to push to falkor drunk 😬