search

postmanlabs / newman

Newman is a command-line collection runner for Postman
https://www.postman.com
Apache License 2.0
6.78k stars 1.15k forks source link

Parameter --timeout not stopping collection run #3210

Open AndreasFQuest opened 4 months ago

AndreasFQuest commented 4 months ago
  1. Newman Version (can be found via newman -v): 6.1.1
  2. OS details (type, version, and architecture): docker on ubuntu 22.04
  3. Are you using Newman as a library, or via the CLI? CLI (docker image postman/newman:latest)
  4. Did you encounter this recently, or has this bug always been there: can't tell, first time user
  5. Expected behaviour: Collection execution stops when global timeout is exceeded
  6. Command / script used to run Newman: 
    time \
docker run --rm -v ~/collections/:/etc/newman -t postman/newman \
run timeout.postman_collection.json --insecure --reporters cli --reporter-cli-show-timestamps --timeout 15000
  7. Sample collection, and auxiliary files (minus the sensitive details): timeout.postman_collection.json
  8. Screenshots (if applicable):
    note the total run time of 91 seconds (1:31.64) compared to the 15 seconds timeout. image

Steps to reproduce the problem:

  1. run the supplied collection with a timeout of less than 12 minutes (e.g. with the command supplied above)
  2. measure the total runtime of newman
AndreasFQuest commented 4 months ago

Same setup but timeout increased to 3 minutes (180000ms). Expected runtime: just over 3 minutes. Actual runtime 13:20.55 minutes. image