OpenNeuroOrg / openneuro

A free and open platform for analyzing and sharing neuroimaging data
https://openneuro.org/
MIT License
111 stars 39 forks source link

test_move_files_nesting results(?) in "Fatal Python error: Segmentation fault" once in a while #3142

Open yarikoptic opened 1 week ago

yarikoptic commented 1 week ago

Initially observed in

============================= test session starts ==============================
platform linux -- Python 3.11.9, pytest-8.3.2, pluggy-1.5.0
rootdir: /home/runner/work/openneuro/openneuro/services/datalad
configfile: pytest.ini
plugins: asyncio-0.24.0, cov-5.0.0, xdist-3.6.1, anyio-4.4.0
asyncio: mode=Mode.AUTO, default_loop_scope=None
created: 4/4 workers
4 workers [96 items]

........................................................................ [ 75%]
Fatal Python error: Segmentation fault
...
=========================== short test summary info ============================
FAILED tests/test_upload.py::test_move_files_nesting
yarikoptic commented 1 week ago

apparently it seems likely to be something fresh! I used https://github.com/con/tinuous to start (from July 2024) fetching all CI logs to my server (let me know if anyone wants access to them). And there it is only these 2 segfaults among thousands of logs:

datalad@smaug:/mnt/datasets/datalad/ci/openneuro/2024$ datalad foreach-dataset -s --o-s relpath git grep 'Segmentation fault'
09/05/push/master/3c4733e/github-Python tests and coverage-473-failed/0_run.txt:2024-09-05T22:10:29.4672531Z Fatal Python error: Segmentation fault                                 
09/05/push/master/3c4733e/github-Python tests and coverage-473-failed/run/11_Run tests and collect coverage.txt:2024-09-05T22:10:29.4672477Z Fatal Python error: Segmentation fault
09/06/pr/3141/2538051/github-Python tests and coverage-481-failed/0_run.txt:2024-09-06T17:17:05.5121907Z Fatal Python error: Segmentation fault
09/06/pr/3141/2538051/github-Python tests and coverage-481-failed/run/11_Run tests and collect coverage.txt:2024-09-06T17:17:05.5121866Z Fatal Python error: Segmentation fault
datalad@smaug:/mnt/datasets/datalad/ci/openneuro/2024$ ls *                                                                                                                         
07:
01  06  08  09  10  15  16  18  23  31

08:
01  05  07  09  10  12  14  15  19  20  27  28

09:
01  05  06
datalad@smaug:/mnt/datasets/datalad/ci/openneuro/2024$ git show
commit 308dbead16b0f0371eb0eb13c1449b03a99a9d22 (HEAD -> master)
Author: DataLad Team <team@datalad.org>
Date:   Fri Sep 6 13:56:35 2024 -0400

    [tinuous] 10997 logs added

    Produced by tinuous 0.7.0