search

postmanlabs / newman

Newman is a command-line collection runner for Postman
https://www.postman.com
Apache License 2.0
6.88k stars 1.16k forks source link

Need Folder Level Highlighting in the HTML report for Newman #923

Closed jbnok closed 7 years ago

jbnok commented 7 years ago

Version and environment information:

  1. Newman Version (can be found via newman -v): 3.4.3
  2. OS details (type, version, and architecture): Red Hat Enterprise Linux Server 7.2 (Maipo) 3.10.0-327.el7.x86_64
  3. Are you using Newman as a library, or via the CLI? CLI
  4. Did you encounter this recently, or has this bug always been there: Presumably always been there
  5. Expected behaviour: We should have some highlighting at the folder level if there is a failure with in that folder if there is one for ease of tracability
  6. Command / script used to run Newman: /usr/local/lib/node_modules/newman/bin/newman.js run ${COLLECTION_NAME} -e ${ENVIRONMENT_NAME} -r html,cli,json,junit --insecure via Jenkins
  7. Sample collection, and auxilliary files (minus the sensitive details): details are sensitive. Not Provided
  8. Screenshots (if applicable): Not Applicable

Steps to reproduce the problem:

  1. Run a test collection in newman that contains multiple folders and at least one test that will fail

OBSERVE: There is no highlighting to be able to see where there is a failed test (i.e. in which folder) in the HTML Report

PROPOSED MITIGATION: It would be nice if the folder name could be highlighted (Red or Pink) to demonstrate that there was a failure with a test in that folder in the HTML report

kunagpal commented 7 years ago

@jbnok Unfortunately, this is beyond the scope of the built in Newman reporters. However, you're more than welcome to create your very own custom reporter for the same. For more details, check out https://www.getpostman.com/docs/postman/collection_runs/command_line_integration_with_newman#custom-reporters.