search

teemtee / tmt

Test Management Tool
MIT License
85 stars 129 forks source link

pytest-container flake with locking #3319

Open thrix opened 1 month ago

thrix commented 1 month ago

We are hitting this sometin in CI, and the reported also hit it locally when using parallel execution via python-xdist.

See for more details https://github.com/dcermak/pytest_container/issues/232

More debugging is needed to find the root cause, asked also the upstream for some pointers.

psss commented 3 weeks ago

Here's a recent job with the failure.

psss commented 3 weeks ago

And here's one more.

psss commented 1 week ago

A bit different example of vanished files:

err: file has vanished: "/var/ARTIFACTS/work-fullovhc3ar2/plans/install/pip/full/provision/guests.yaml.copy"
err: rsync warning: some files vanished before they could be transferred (code 24) at main.c(1338) [sender=3.3.0]

Here's the job for reference.

happz commented 1 week ago

A bit different example of vanished files:

err: file has vanished: "/var/ARTIFACTS/work-fullovhc3ar2/plans/install/pip/full/provision/guests.yaml.copy"
err: rsync warning: some files vanished before they could be transferred (code 24) at main.c(1338) [sender=3.3.0]

Here's the job for reference.

That's a different issue, this one's TF bug: TF creates copies of files inside tmt workdir, tmt runs rsync, rsync notices them - but TF removes the files because it copied them elsewhere and they are no longer needed, and rsync complains about vanishing files. These copies should not exist, and TF is working on fixing it.