search

testomatio / app

Testomat.io is a simplified test management system for your automated tests. Issues, project board & documentation. app.testomat.io
https://app.testomat.io
26 stars 2 forks source link

Improve reporting run status for automated tests #968

Open TetianaKhomenko opened 3 months ago

TetianaKhomenko commented 3 months ago

Describe the bug

original request

Details

playwright, ts "@testomatio/reporter": "1.2.1" test executed from cli - playwright has testomatio reported enabled It worked all fine for months until this one

this data comes from API

CleanShot 2024-03-18 at 14 45 48@2x

The test execution happened across 5 github runners All of them were completed with 0 exit code There were 2 executors that have got 2 test failed (1 per each) Those 2 tests were rerun successfully at 1st attempt Playwright reported them as flaky

Screenshots

image

CleanShot 2024-03-18 at 14 22 42@2x

TetianaKhomenko commented 1 month ago

The issue still persists. Reported by user, tested on reporter version: 1.2.0, framework: playwright 1.40.1.

Image

TetianaKhomenko commented 1 week ago

I suggest re-testing the issue after new report version release. Moving ticket to the next release.