postmanlabs / newman

Newman is a command-line collection runner for Postman
https://www.postman.com
Apache License 2.0
6.83k stars 1.16k forks source link

Responses Status for 422 are having detailed information with 6.2.0 #3271

Open AmirthavalliG opened 3 weeks ago

AmirthavalliG commented 3 weeks ago
  1. Newman Version (can be found via newman -v): 6.2.0
  2. OS details (type, version, and architecture): 2.3 GHz Quad-Core Intel Core i7, MacOs Sonoma
  3. Are you using Newman as a library, or via the CLI? cli
  4. Did you encounter this recently, or has this bug always been there: No this started occuring with 6.2.0
  5. Expected behaviour: the response status shouldnt contain detailed information
  6. Command / script used to run Newman: newman run sample.postman_collection.json -e sample-gh.postman_environment.json
  7. Sample collection, and auxiliary files (minus the sensitive details): sample.postman_collection.json sample-gh.postman_environment.json
  8. Screenshots (if applicable): Screenshot 2024-08-20 at 3 06 54 PM Screenshot 2024-08-20 at 3 07 06 PM

Steps to reproduce the problem:

  1. Create a repo in GH, and a dummy file
  2. Fill in the necessary details in the newman env file
  3. run the collection newman run sample.postman_collection.json -e sample-gh.postman_environment.json With 6.2.0 : the tests would fail because the status is detailed. With 6.1.3 : the tests would pass because the status is not detailed.

Why did this change ? We have certain collections which started failing all of sudden due to this.