avocado-framework / avocado

Avocado is a set of tools and libraries to help with automated testing. One can call it a test framework with benefits. Native tests are written in Python and they follow the unittest pattern, but any executable can serve as a test.
https://avocado-framework.github.io/
Other
336 stars 335 forks source link

Time normalization #5915

Closed richtja closed 2 months ago

richtja commented 2 months ago

The reason for this is the actual-needed timeouts are dependent on the environment. It's not OK to expect the test code to be modified when the environment changes significantly for an execution of the tests (say on faster or slower CPUs or networks).

There has been some work done on this topic in #5820 which introduces timeout factor for the whole suite. But we need to investigate it further. We need to find a way how to adjust timeouts not only for the entire suite, but also for a specific test or even part of the test.

clebergnu commented 2 months ago

We'll be using the Dovetail instance issue to track this: https://gitlab.com/avocado-framework/dovetail/-/issues/4