datalad / datalad-crawler

DataLad extension for tracking web resources as datasets
http://datalad.org
Other
5 stars 16 forks source link

RuntimeError: git status 'AM' not yet supported. TODO #108

Closed yarikoptic closed 2 years ago

yarikoptic commented 2 years ago

we managed to hit that state in a few tests with "bleeding edge" build of git annex standalone:

2021-10-04T02:24:17.9199241Z ======================================================================
2021-10-04T02:24:17.9199938Z ERROR: datalad_crawler.pipelines.tests.test_balsa.test_balsa_pipeline1
2021-10-04T02:24:17.9200908Z ----------------------------------------------------------------------
...
2021-10-04T02:24:17.9237827Z     for data_ in data_in_to_loop:
2021-10-04T02:24:17.9239037Z   File "/opt/hostedtoolcache/Python/3.7.12/x64/lib/python3.7/site-packages/datalad_crawler/pipeline.py", line 194, in xrun_pipeline
2021-10-04T02:24:17.9240314Z     for idata_out, data_out in enumerate(xrun_pipeline_steps(pipeline, data_in, output=output_sub)):
2021-10-04T02:24:17.9241919Z   File "/opt/hostedtoolcache/Python/3.7.12/x64/lib/python3.7/site-packages/datalad_crawler/pipeline.py", line 286, in xrun_pipeline_steps
2021-10-04T02:24:17.9242889Z     for data_out in xrun_pipeline_steps(pipeline_tail, data_, output=output):
2021-10-04T02:24:17.9244132Z   File "/opt/hostedtoolcache/Python/3.7.12/x64/lib/python3.7/site-packages/datalad_crawler/pipeline.py", line 270, in xrun_pipeline_steps
2021-10-04T02:24:17.9244951Z     for data_ in data_in_to_loop:
2021-10-04T02:24:17.9245960Z   File "/opt/hostedtoolcache/Python/3.7.12/x64/lib/python3.7/site-packages/datalad_crawler/nodes/annex.py", line 548, in __call__
2021-10-04T02:24:17.9246789Z     changed = set().union(*self._get_status(args=[fpath]))
2021-10-04T02:24:17.9247897Z   File "/opt/hostedtoolcache/Python/3.7.12/x64/lib/python3.7/site-packages/datalad_crawler/nodes/annex.py", line 933, in _get_status
2021-10-04T02:24:17.9249024Z     raise RuntimeError("git status %r not yet supported. TODO" % act)
2021-10-04T02:24:17.9249917Z RuntimeError: git status 'AM' not yet supported. TODO

but may be it is just side effect from other changes in behavior, see e.g. https://github.com/datalad/datalad/issues/6029

yarikoptic commented 2 years ago

seems to be a bug in git-annex (likely that left over print statement fix), resolved by using 8.20210903+git120-gdb55bec8b