extent-framework / extentreports-testng-adapter

TestNG Adapter for Extent Framework
http://extentreports.com/docs/versions/4/java/testng.html
Apache License 2.0
50 stars 14 forks source link

Using suite xml configurations causes methods to be reported more than once #22

Open mtorres10 opened 3 years ago

mtorres10 commented 3 years ago

Expected Behavior Executing a suite.xml using ExtentITestListenerClassAdapter should report each method call a single time. image

Current Behavior Executing a suite.xml using ExtentITestListenerClassAdapter reports each method call several times. image

Steps to Reproduce

  1. Download testng-sample
  2. Add the following suite.xml (rename from .txt to .xml): TestSuite.txt
  3. Execute suite.

Alternatively download updated example from this branch and execute TestSuite.xml: https://github.com/mtorres10/examples/tree/feature/UpdateReportsVersionTo5

Additional Information It seems listener behaves differently when using suites. This behavior does not happens when using surefire without suites (using includes and excludes). This issue is present on previous versions of the adapter as well. Using adapter 1.0.6 and reports 4.0.6 behaves the same way.

Attaching both reports for comparison SparkReport using xml suite.zip SparkReport.zip