search

Shelex / cypress-allure-plugin

cypress plugin to use allure reporter api in tests
https://shelex.github.io/cypress-allure-plugin-example/
Apache License 2.0
156 stars 43 forks source link

Cypress Allure report shows a count of failed test cases that is less than the actual count. #223

Open nthallap opened 9 months ago

nthallap commented 9 months ago

Describe the bug When I run several Cypress test cases(50 test cases) around 20 test cases are failing. When i check cypress allure reports, It will show total count and failed test count less than actual.

It happens occasionally. Sometimes no reports are generated.

To Reproduce Steps to reproduce the behavior:

  1. Run Cypess test cases, in that some test should fail

Expected behavior Total test cases count and failed test cases count in the allure reports should match with terminal output after execution.

Environment (please complete the following information):

Developer Tools Console Output

image

Additional context In the above scenario total test cases 51, passed 11 failed 35, skipped 2, but showing as below

image

nthallap commented 9 months ago

Hi All, any one checked on this issue ?

Shelex commented 7 months ago

Hi @nthallap!

There could be various reasons for that, and most common - when tests have same names accross suites then other test case is calculated as a retry in allure. Would be nice to check allure-results folder to check if recorded information is fine and no tests are missing. Or just try https://github.com/Shelex/cypress-allure-plugin?tab=readme-ov-file#debugging for writer task to check that all information is written to allure-results.