elastic / kibana

Your window into the Elastic Stack
https://www.elastic.co/products/kibana
Other
19.69k stars 8.11k forks source link

[Security Solution] Reintroducing burn in Cypress #174902

Open MadameSheema opened 7 months ago

MadameSheema commented 7 months ago

The concept of "burning tests" in the context of Cypress refers to running tests repeatedly to ensure their reliability and stability. This practice is beneficial for identifying and addressing flakiness, statelessness, and order independence in tests. By burning tests, any new or modified tests are rerun multiple times to detect and prevent potential issues, ultimately contributing to the overall robustness of the testing suite. The burning test approach can help in achieving resilient test results and save buildkite time if we use it as a source of truth for flakiness instead of the flaky test suite runner.

More context:

elasticmachine commented 7 months ago

Pinging @elastic/security-solution (Team: SecuritySolution)