search

grasshopper7 / extentreports-cucumber7-adapter

Cucumber-JVM 7 Adapter for Extent Framework
https://ghchirp.online/3196/
MIT License
18 stars 9 forks source link

Ignore Testng Retried tests results #22

Open Soumendu-Khilar opened 1 year ago

Soumendu-Khilar commented 1 year ago

Currently when a Cucumber test case is retried using Retry Analyzer the result of all the runs for a test case is displayed in extent reports. This is causing an issue where if a test case PASSES in the second run the overall status still shows that the feature has FAILED. Is there any implementation to include only the last run of a test. Run 1 - Failed Run 2 - Failed Run 3 - Passed

Only Passed result to attach in extent reports.

grasshopper7 commented 1 year ago

There is no solution to remove failed tests in retried scenarios. Tests should not be removed from the report without the user knowing abut it. Will have a look at a solution.

Soumendu-Khilar commented 1 year ago

Can their be a workaround for this because as of now if there is a failed test case then the entire feature is marked as failed irrespective of if the retried test run passes. This behavior is incorrect.

grasshopper7 commented 1 year ago

Currently I do not have spare time to look at this. Not exactly sure about timelines. I would suggest you look at another reporting solution which addresses this specific need. Thx.

darasandeep91 commented 1 year ago

@Soumendu-Khilar did you find any solution for the problem that you mentioned above.

Soumendu-Khilar commented 1 year ago

@darasandeep91 No, I didn't find any solution.

grasshopper7 commented 1 year ago

THis has been added in version 5.1.0 of the extent report with a configuration setting. Please go through the changelog in the extentreport repository

rameshkhatri1 commented 1 year ago

@grasshopper7 I am using extentreports-cucumber7-adapter Version: 1.14.0 . I do not found the docs about retried test. I tried adding keepLastRetryOnly=true in extent.properties but it did not work. Could you please help on what to keep on properties file or provide me the docs link where this information is provided. Thank you

grasshopper7 commented 1 year ago

https://github.com/extent-framework/extentreports-java/issues/386 you are right it needs to be enabled in the adapter code. I will reopen and fix this. Thx.

SSINGHPR commented 9 months ago

Following This +

I have a similar issue reported with this request, since I am not sure if it was fixed yet like mentioned by the @grasshopper7 above:
https://github.com/grasshopper7/extentreports-cucumber7-adapter/issues/38

Thanks for all your help @grasshopper7.

Sumit-Systango commented 2 months ago

@rameshkhatri1 DId you find any solution for this ? I'm still not sure where to use the "keepLastRetryOnly=true".