OS details: Microsoft Windows 10 [Version 10.0.18363.1916] 64-bit
Are you using Newman as a library, or via the CLI? CLI
Did you encounter this recently, or has this bug always been there: always
Expected behaviour: run a collection and receive just the CLI summary back, particularly in conjunction with other reporters exporting files
Command / script used to run Newman: newman run "Postman Echo.postman_collection.json" -r cli,html --reporter-cli-no-failures --reporter-cli-no-assertions --reporter-cli-no-success-assertions --reporter-cli-no-console --reporter-cli-no-banner
Sample collection, and auxiliary files (minus the sensitive details): Postman-echo
Screenshots (if applicable):
Story
As a newman CLI user, I want to run multiple reporters for my collection and get a simple summary output within the CLI so that I can spot obvious problems quickly.
Proposed Acceptance Criteria
user can set a --reporter-cli-show-summary parameter (or similar language) to ensure that the cli summary is shown even if --reporter-cli-silent or the various other --reporter-cli options are set to disable output.
alternative - user sets a --reporter-cli-summary-only option which disables all other output except for the summary. I could also see this including the failures at the end of the run unless --reporter-cli-no-failure was set
This option could be used in conjunction with other reporters like html/htmlextra so that a more detailed report can be written to a file, but the summary would appear within the CLI or console during a run.
newman run "Postman Echo.postman_collection.json" -r cli,html --reporter-cli-no-failures --reporter-cli-no-assertions --reporter-cli-no-success-assertions --reporter-cli-no-console --reporter-cli-no-banner
Story
As a newman CLI user, I want to run multiple reporters for my collection and get a simple summary output within the CLI so that I can spot obvious problems quickly.
Proposed Acceptance Criteria
--reporter-cli-show-summary
parameter (or similar language) to ensure that the cli summary is shown even if --reporter-cli-silent or the various other --reporter-cli options are set to disable output.--reporter-cli-summary-only
option which disables all other output except for the summary. I could also see this including the failures at the end of the run unless--reporter-cli-no-failure
was setdesired output: