search

runtimeverification / k

K Framework Tools 7.0
BSD 3-Clause "New" or "Revised" License
452 stars 150 forks source link

CI flakiness #4199

Open ehildenb opened 8 months ago

ehildenb commented 8 months ago

One example of CI flakiness is here: https://github.com/runtimeverification/pyk/actions/runs/8330698269/job/22796012460?pr=991. It happens when a RPC server cannot be started: image

I've tried increasing the default timeout (which is 2s) to 3s, and that did not address it. So I think it's something else causing the hangs/flakiness. This happens I would say on at least 30% of PRs, which can be quite annoying.

ehildenb commented 8 months ago

Another example where even a timeout of 5s is being flaky: https://github.com/runtimeverification/pyk/actions/runs/8353934182/job/22866474429?pr=1001

ehildenb commented 8 months ago

And another: https://github.com/runtimeverification/pyk/actions/runs/8360004880/job/22884716424?pr=1001

ehildenb commented 8 months ago

And again (3x in a row for this PR): https://github.com/runtimeverification/pyk/actions/runs/8360004880/job/22888936085?pr=1001

Baltoli commented 8 months ago

@tothtamas28 indicated this is now resolved.

ehildenb commented 8 months ago

Another one? https://github.com/runtimeverification/pyk/actions/runs/8524694649/job/23349935919?pr=1046