astarte-platform / astarte

Core Astarte Repository
https://docs.astarte-platform.org/
Apache License 2.0
240 stars 46 forks source link

Flaky Realm Management Tests #977

Open eddbbt opened 3 months ago

eddbbt commented 3 months ago

Sometimes Realm Management fail due to random errors and/or due to longer-than-usual waiting times.

We have no clues about the real reasons, like we have with the trigger ones

See the trigger one for a possible fix, but please don't assume the reason is similar.

Steps to reproduce:

It would happen also that tests passes without errors this is not a symptom of a successful fix, it is mandatory to repeat the workflow to test its effectiveness.

Please note, this kind of test failure is difficult to notice in a local environment, mostly because GitHub environment is slower enough to trigger this behavior more frequently

example of randomly failing test image