search

ocaml-multicore / multicoretests

PBT testsuite and libraries for testing multicore OCaml
https://ocaml-multicore.github.io/multicoretests/
BSD 2-Clause "Simplified" License
37 stars 16 forks source link

Timeouts during 'Lin.Internal CList int64 test with Thread' under Cygwin #397

Open jmid opened 1 year ago

jmid commented 1 year ago

This is an existing issue which we have been observing and battling repeatedly. I now saw it again and decided to track it separately from the general #338 and #384. Overall this is in the gray zone between 'test suite reliability' and an 'ocaml5 issue' .

Whereas #389 took care of disabling shrinking to prevent long shrink runs, we are now just left with ... long runs :grimacing: The latest occurrence happened Cygwin trunk/5.2 part 1, which was cancelled during a 7712.9s run: https://github.com/ocaml-multicore/multicoretests/actions/runs/6169402841/job/16752622025

random seed: 489742295
generated error fail pass / total     time test name

[ ]    0    0    0    0 / 1000     0.0s Lin CList int test with Thread
[ ]    0    0    0    0 / 1000     0.0s Lin CList int test with Thread (generating)
[ ]  162    0    0  162 / 1000    70.8s Lin CList int test with Thread
[...]
[ ]  894    0    0  894 / 1000  1094.1s Lin CList int test with Thread
[ ]  989    0    0  989 / 1000  1155.8s Lin CList int test with Thread
[✓] 1000    0    0 1000 / 1000  1157.1s Lin CList int test with Thread

[ ]    0    0    0    0 / 1000     0.0s Lin CList int64 test with Thread
[ ]   11    0    0   11 / 1000   149.3s Lin CList int64 test with Thread
[ ]   15    0    0   15 / 1000   290.7s Lin CList int64 test with Thread
[ ]   18    0    0   18 / 1000   381.1s Lin CList int64 test with Thread
[...]
[ ]  883    0    0  883 / 1000  6348.6s Lin CList int64 test with Thread
[ ]  886    0    0  886 / 1000  6552.9s Lin CList int64 test with Thread
[ ]  888    0    0  888 / 1000  6713.8s Lin CList int64 test with Thread
[ ]  891    0    0  891 / 1000  6812.7s Lin CList int64 test with Thread
[ ]  894    0    0  894 / 1000  7628.3s Lin CList int64 test with Thread
[ ]  896    0    0  896 / 1000  7712.9s Lin CList int64 test with Thread
Error: The operation was canceled.

A previous recent occurrence was in #387.

jmid commented 1 year ago

This timed out again on the 0.3 release branch under Cygwin trunk / part2 https://github.com/ocaml-multicore/multicoretests/actions/runs/6481561492/job/17612305533

random seed: 117786625
generated error fail pass / total     time test name

[ ]    0    0    0    0 / 1000     0.0s Lin.Internal CList int test with Thread
[ ]    0    0    0    0 / 1000     0.0s Lin.Internal CList int test with Thread (generating)
[ ]  183    0    0  183 / 1000    60.0s Lin.Internal CList int test with Thread
[ ]  268    0    0  268 / 1000   126.9s Lin.Internal CList int test with Thread
[...]
[ ]  931    0    0  931 / 1000   994.8s Lin.Internal CList int test with Thread (collecting)
[ ]  942    0    0  942 / 1000  1071.8s Lin.Internal CList int test with Thread
[ ]  960    0    0  960 / 1000  1140.9s Lin.Internal CList int test with Thread
[✓] 1000    0    0 1000 / 1000  1146.0s Lin.Internal CList int test with Thread

[ ]    0    0    0    0 / 1000     0.0s Lin.Internal CList int64 test with Thread
[ ]   84    0    0   84 / 1000    65.5s Lin.Internal CList int64 test with Thread
[ ]   99    0    0   99 / 1000   161.8s Lin.Internal CList int64 test with Thread
[ ]  212    0    0  212 / 1000   233.7s Lin.Internal CList int64 test with Thread
[...]
[ ]  812    0    0  812 / 1000  3608.7s Lin.Internal CList int64 test with Thread
[ ]  815    0    0  815 / 1000  3676.4s Lin.Internal CList int64 test with Thread
[ ]  816    0    0  816 / 1000  4053.7s Lin.Internal CList int64 test with Thread
[ ]  820    0    0  820 / 1000  4119.1s Lin.Internal CList int64 test with Thread
[ ]  825    0    0  825 / 1000  4232.8s Lin.Internal CList int64 test with Thread
Error: The operation was canceled.
jmid commented 1 year ago

This also timed out on the 0.3 merge to main under Cygwin 5.1 / part2 https://github.com/ocaml-multicore/multicoretests/actions/runs/6483174720/job/17612768749

random seed: 25553377
generated error fail pass / total     time test name

[ ]    0    0    0    0 / 1000     0.0s Lin.Internal CList int test with Thread
[ ]    0    0    0    0 / 1000     0.0s Lin.Internal CList int test with Thread (generating)
[ ]  172    0    0  172 / 1000    60.1s Lin.Internal CList int test with Thread
[ ]  263    0    0  263 / 1000   121.2s Lin.Internal CList int test with Thread
[ ]  344    0    0  344 / 1000   199.0s Lin.Internal CList int test with Thread
[...]
[ ]  971    0    0  971 / 1000  1659.0s Lin.Internal CList int test with Thread
[ ]  983    0    0  983 / 1000  1734.1s Lin.Internal CList int test with Thread
[ ]  986    0    0  986 / 1000  1837.4s Lin.Internal CList int test with Thread
[ ]  993    0    0  993 / 1000  1899.1s Lin.Internal CList int test with Thread
[✓] 1000    0    0 1000 / 1000  1934.4s Lin.Internal CList int test with Thread

[ ]    0    0    0    0 / 1000     0.0s Lin.Internal CList int64 test with Thread
[ ]   67    0    0   67 / 1000    24.9s Lin.Internal CList int64 test with Thread
[ ]  105    0    0  105 / 1000   173.2s Lin.Internal CList int64 test with Thread
[ ]  110    0    0  110 / 1000   276.8s Lin.Internal CList int64 test with Thread
[ ]  114    0    0  114 / 1000   422.2s Lin.Internal CList int64 test with Thread
[...]
[ ]  769    0    0  769 / 1000  6122.7s Lin.Internal CList int64 test with Thread
[ ]  777    0    0  777 / 1000  6223.8s Lin.Internal CList int64 test with Thread
[ ]  783    0    0  783 / 1000  6335.4s Lin.Internal CList int64 test with Thread
[ ]  788    0    0  788 / 1000  6419.0s Lin.Internal CList int64 test with Thread
[ ]  792    0    0  792 / 1000  6525.9s Lin.Internal CList int64 test with Thread
Error: The operation was canceled.
jmid commented 1 year ago

I updated the title to reflect the #396 and #408 renaming