postmanlabs / newman-reporter-html

Apache License 2.0
82 stars 86 forks source link

First request reports, in the exported HTML, one more Pass Count and one more Total passed tests, for each pm.sendRequest that is executed within collection or folder Pre-request Scripts #188

Open filipeamaral opened 6 years ago

filipeamaral commented 6 years ago
  1. Newman Version (can be found via newman -v): 4.0.1

  2. OS details (type, version, and architecture): Mac OS X, 10.13.6, x86_64/i386

  3. Are you using Newman as a library, or via the CLI? Node library

  4. Did you encounter this recently, or has this bug always been there: At least since 3.9.4

  5. Expected behaviour: The request report should only report an assertion count (Pass Count) based on iterations (one in the example provided). Total passed tests becomes also wrong due to the erroneous assertion count.

  6. Command / script used to run Newman: newman.run

  7. Sample collection, and auxiliary files (minus the sensitive details): Archive.zip

  8. Screenshots (if applicable): Collection's HTML report can be found in archive, which highlights the described problem.

shamasis commented 6 years ago

Yeah. We need to update the Newman HTML reporter to better handle sent requests. We’ve moved the reporter to its own repo in Newman v4 and would take them up there soon(ish). Any help there would also be great!

filipeamaral commented 6 years ago

I could help. Just send me an e-mail.

Also, I've discovered a new bug related with the HTML reporter. Should I open an issue on https://github.com/postmanlabs/newman-reporter-html/issues or still here?