ReproNim / reproman

ReproMan (AKA NICEMAN, AKA ReproNim TRD3)
https://reproman.readthedocs.io
Other
24 stars 14 forks source link

run: handle presence of a sibling "smoother"? #440

Open yarikoptic opened 5 years ago

yarikoptic commented 5 years ago
  1. initial run failed to another issue (#442)
  2. I have tried to rerun but even removing remotes etc in the dataset but it didn't help
  3. only then I realized that in
…nim/reproman-master/docs/usecases/bids-fmriprep-workflow-NP/out > reproman run --follow -r "${RM_RESOURCE}" --sub "${RM_SUB}" --orc "${RM_ORC}" --jp container=containers/bids-mriqc data/bids data/mriqc participant,group
2019-07-24 15:05:27,464 [INFO   ] No root directory supplied for smaug; using '/home/yoh/.reproman/run-root' 
[INFO   ] Connecting ... 
ECDSA host key for IP address '129.170.233.9' not in list of known hosts.
[INFO   ] Considering to create a target dataset /home/yoh/proj/repronim/reproman-master/docs/usecases/bids-fmriprep-workflow-NP/out at /home/yoh/.reproman/run-root/1ab254ca-ad49-11e9-95c1-8019340ce7f2 of smaug 
[INFO   ] Fetching updates for <Dataset path=/home/yoh/proj/repronim/reproman-master/docs/usecases/bids-fmriprep-workflow-NP/out> 
.: smaug(+) [ssh://smaug/home/yoh/.reproman/run-root/1ab254ca-ad49-11e9-95c1-8019340ce7f2 (git)]                                                                                                                                  
[INFO   ] Adjusting remote git configuration 
[INFO   ] Running post-update hooks in all created siblings 
2019-07-24 15:05:32,319 [ERROR  ] Command did not complete successfully [{'action': 'create_sibling', 'type': 'dataset', 'status': 'error', 'gitshasum': '8a0ef936dd4195cef2b81e2c3eb305594e154733', 'path': '/home/yoh/proj/repronim/reproman-master/docs/usecases/bids-fmriprep-workflow-NP/out/containers', 'revision': '8a0ef936dd4195cef2b81e2c3eb305594e154733', 'gitmodule_url': 'http://datasets.datalad.org/repronim/containers/.git', 'gitmodule_datalad-id': 'b02e63c2-62c1-11e9-82b0-52540040489c', 'gitmodule_name': 'containers', 'parentds': '/home/yoh/proj/repronim/reproman-master/docs/usecases/bids-fmriprep-workflow-NP/out', 'refds': '/home/yoh/proj/repronim/reproman-master/docs/usecases/bids-fmriprep-workflow-NP/out', 'registered_subds': True, 'message': ("sibling '%s' already configured (specify alternative name, or force reconfiguration via --existing", 'smaug')}, {'action': 'create_sibling', 'type': 'dataset', 'status': 'error', 'gitshasum': '12e1aeceaca008645da36a67c026537932caeaee', 'path': '/home/yoh/proj/repronim/reproman-master/docs/usecases/bids-fmriprep-workflow-NP/out/data/bids', 'revision': '12e1aeceaca008645da36a67c026537932caeaee', 'gitmodule_url': 'https://github.com/ReproNim/ds000003-demo', 'gitmodule_datalad-id': '9040fae2-8704-11e8-aff3-0242ac12000c', 'gitmodule_name': 'data/bids', 'parentds': '/home/yoh/proj/repronim/reproman-master/docs/usecases/bids-fmriprep-workflow-NP/out', 'refds': '/home/yoh/proj/repronim/reproman-master/docs/usecases/bids-fmriprep-workflow-NP/out', 'registered_subds': True, 'message': ("sibling '%s' already configured (specify alternative name, or force reconfiguration via --existing", 'smaug')}, {'action': 'create_sibling', 'type': 'dataset', 'status': 'error', 'gitshasum': 'de0cb795b5e9457f8d8d2c73b89df7ec77042d8e', 'path': '/home/yoh/proj/repronim/reproman-master/docs/usecases/bids-fmriprep-workflow-NP/out/data/mriqc', 'revision': 'de0cb795b5e9457f8d8d2c73b89df7ec77042d8e', 'gitmodule_url': './data/mriqc', 'gitmodule_datalad-id': '214aaff8-ad49-11e9-95c1-8019340ce7f2', 'gitmodule_name': 'data/mriqc', 'parentds': '/home/yoh/proj/repronim/reproman-master/docs/usecases/bids-fmriprep-workflow-NP/out', 'refds': '/home/yoh/proj/repronim/reproman-master/docs/usecases/bids-fmriprep-workflow-NP/out', 'registered_subds': True, 'message': ("sibling '%s' already configured (specify alternative name, or force reconfiguration via --existing", 'smaug')}] [utils.py:generator_func:467] (IncompleteResultsError) 

it was actually complaining about ./containers subdataset (not this superdataset) already having a smaug remote.
I think that ideally

(reproman local version is from run-subjobs branch v0.1.0-539-g2c87dcc)