Improvements-to-acceptance-test-resiliency - Githubissues

qentinelqi / qweb

Keyword driven automation for the web

https://github.com/qentinelqi/qweb

Apache License 2.0

40 stars 17 forks source link

Improvements-to-acceptance-test-resiliency #85

Closed turunenm closed 2 years ago

turunenm commented 2 years ago

Workflows:

Failure in a OS-workflow does no longer automatically fail other workflows on the same OS
Acceptance tests -step timeouts after 30 minutes (recently some tests have halted completely for two hours)
Added few new conditional steps - if acceptance tests fail
- Rerun failed acceptance testsuites
- Merge test results
Updated external action dependencies
- Checkout V2 -> V3
- Setup-Python V2 -> V3

Acceptance tests:

Tried to tighten test timeouts
- Futile attempt, changed format from 1min to 60 seconds
- browser.robot and window.robot timeouts were increased to 90 seconds
Fixed IDE reference errors from acceptance tests by declaring "missing" variables at variables table

Rerun examples: https://github.com/qentinelqi/qweb/actions/runs/2382295616 https://github.com/qentinelqi/qweb/actions/runs/2382295617