Running multiple collections in Collection Runner

[davenewza]

The Collection Running currently only has the ability to run one collection at a time. It would be advantageous to be able to select and run multiple collections in the test run.

In the Runner, the collection list view could be amended to be a multiselect list view:

[ChrissiFi]

I'm also finding that the Collection Runner does not always run all the tests in my collection - I have a collection with over a dozen folders, each containing multiple gets (each with an average of about 6 tests). When I started using Postman I could run the whole collection with no problems. Now only the first few folders are run through and sometimes I only get the first few tests from a selected folder.

[abhijitkane]

@ChrissiFi Can you confirm the Postman version you're on? Also, are there any errors in the console (http://blog.getpostman.com/2015/06/13/debugging-postman-requests/)? (Right click on the runner > Inspect element)

[ChrissiFi]

I'm on 4.1.3. I've just chosen to run an entire collection and have circled where the runner finished (well under a quarter of the way through). All but one of the tests highlighted as fails at the bottom succeed when run in the builder. [image: Inline image 1]

On Tue, Apr 5, 2016 at 11:11 AM, Abhijit Kane notifications@github.com wrote:

@ChrissiFi https://github.com/ChrissiFi Can you confirm the Postman version you're on? Also, are there any errors in the console ( http://blog.getpostman.com/2015/06/13/debugging-postman-requests/)? (Right click on the runner > Inspect element)

— You are receiving this because you were mentioned. Reply to this email directly or view it on GitHub https://github.com/postmanlabs/postman-app-support/issues/1966#issuecomment-205741341

[abhijitkane]

@ChrissiFi I can't see the image. Can you try attaching it again or sending a dropbox link? A screenshot of the console would be helpful too.

[ChrissiFi]

Hopefully this will work better. I selected to run all tests in the collection, I've circled the last one it ran (seems to terminate correctly and reactivates the start test button but just doesn't run all the tests). Interestingly the test that failed with 400 and 403 succeed when run through the builder (they're actually both checking that those errors are given).

On Tue, Apr 5, 2016 at 11:54 AM, Abhijit Kane notifications@github.com wrote:

@ChrissiFi https://github.com/ChrissiFi I can't see the image. Can you try attaching it again or sending a dropbox link? A screenshot of the console would be helpful too.

— You are receiving this because you were mentioned. Reply to this email directly or view it on GitHub https://github.com/postmanlabs/postman-app-support/issues/1966#issuecomment-205755051

[abhijitkane]

@ChrissiFi Still can't see the image. Can you attach a dropbox link?

[ChrissiFi]

Try https://www.dropbox.com/s/gkphe13gao993l0/Console.png?dl=0

Chrissi

On Tue, Apr 5, 2016 at 12:31 PM, Abhijit Kane notifications@github.com wrote:

@ChrissiFi https://github.com/ChrissiFi Still can't see the image. Can you attach a dropbox link?

— You are receiving this because you were mentioned. Reply to this email directly or view it on GitHub https://github.com/postmanlabs/postman-app-support/issues/1966#issuecomment-205763869

[mstaalesen]

You have an error in your test, because you are getting a return from the server that you are not expecting. This is (99% certain) the reason not all of your tests are executed. Postman Collection Runner stops on errors.

[davenewza]

This has gone completely off topic.

[bruno-lopes]

I think the original request (Running multiple collections in CollectionRunner) is very valuable. @a85, are there any plans to implement this feature?

[marcelubach]

I'm also looking forward to have the original feature

[DanielStoica85]

This would be a very useful feature. It's very strange that it wasn't added until now. I think anyone using Postman would want to run multiple collections at the same time. Any news on this?

[sdnts]

@DanielStoica85 In the native apps, you can run multiple collections at the same time, although they'll have to be started individually manually. We're looking into allowing you to select multiple collections to run them parallely :)

[DanielStoica85]

Well, if you run the collections one at a time, then you are not really starting them at the same time. Just to make it clear, I don't want the collections to run parallely, I want to be able to run a suite of collections, like a suite of test cases.

[akomba]

This is probably the most important missing feature for me as well. Is there any workaround? Running it from the command line with newman?

[sunill-yadav]

I am running Postman collection through #newman using #VSTS build. I created #multiple collections for set of APIs as per functionality and thinking to run them all at a time and also running them individual when ever any of them get failed.

I am using postman v4.9.3, Is there any way to #run multiple collections? Even from #newman command line?

[sdnts]

@sunill-yadav Using the app, not right now.

[sunill-yadav]

@madebysid ok, Any other ways to do the same?

I was thinking to have all the tests in the same collection and run it as single collection but it will mash up all my tests.

[otoniel-isidoro]

+1

[sdnts]

@sunill-yadav Have you tried out the native app? The native app has a redesigned runner that should help solve your issue.

[a85]

Closing as available in native apps: www.getpostman.com/apps

[youyou82]

@a85 and @madebysid : we are using the latest version of the native app (ie v4.10.7) Selection of multiple test collections in the Runner seems not available. Could you help on this and re-open this request as a feature if not available?
This feature would be really useful and ease our testing. Thank you very much.

[a85]

Hmm. Looks like I closed this by mistake. Reopening.

[ashu153535]

I tried to Create a Collection (Sprint) and under Collection Sprint added 2 more Collections as Sprint1 and Sprint2 and dragged dropped or created New Methods under Sprint1 and Sprint2. After that try to run Collection Sprint and that will run all the methods of Sprint1 and Sprint2.

[zoso200]

Would also like to see the original suggestion

[sunilphilip]

Hey @vkaegis : It would be useful if we can assign attach multiple data files to the set of collections. To make it more clear, if we can assign separate data files for each collection.

[vkaegis]

@sunilphilip Thanks for the input. Could you open a new issue for this feature request? This would help us better manage these individual requests.

[BazToth]

Hey Guys, so when is the "run multiple collections" function coming to PRD as this convo has started years ago and haven't seen anything yet. thanks

[hiqqs]

This is probably one of the biggest features missing IMO

[mennopot]

I really would love this. Also for me it would be great if I could run these against several environments. I currently run 3 collections against 5 environments. So 15 times the same thing. That should be automatable. I do export my collections and my environments and run them in the pipeline in Jenkins, but I want quicker checks. If I changed high level things in Postman, or if a developer has changed something in the code, I want to have quick results of the change, on all environments. Also in the pipeline I can't run against all the environments.

Please implement this functionality.

[TonyTrupp]

Similar to the original suggestion, to run multiple collections, please also allow the running of multiple folders. Seems like a UI change could accommodate both at the same time.

[danieladougan]

The original feature request would be very useful for me and my colleagues!

[rrichardsonindy]

The original suggestion -- having the ability to run multiple collections in Postman Runner -- would be valuable for our team.

[tamilselvanps]

Postman yes team, if you add the feature like able to select and run particular list of children folders(Each contains multiple/more requests) inside same parent folder.

And if possible add the following feature too. 1.Can i get the data from Cdn URL which may be in json/xlxs format.(i am unable achieve it through javascript code in Tests Tab) 2.And it seems postman supports only list of NPM packages to run through newman option. Is it possible to make work all the nodejs code(import npm package and use it in Test tab Script) inside postman app itself.

Thanks in Advance.

[pvaland]

Hiya,

Wondering if there's any progress to this, would love to be able to run multiple collections to build up a testsuite.

[SumithraSomu]

Hello all,

@abhijitkane is there any progress on this request man? I know there is an option of running multiple folders via Newman but while building the test suite, we would like to run multiple folders at Collection runner itself. for eg, I have multiple folders from which the first one generates all the needed keys and tokens for the next folders to run. So, I must run the first folder along with the actual tests. Exporting collection every single time I change a small thing, going to CLI and then running multiple folders is kind of taking time. I hope you guys will come with this feature soon.

Thank you, Postman user.

[tamilselvanps]

@SumithraSomu why you cannot try the below method for your requirement.

You need to call the first request of second folder from last request of first folder using below test script. So you can mentioned the order of sequence using this script, so you can run n number of sub folders(event multi level - i have worked with 3 level) with in a parent folder.

Ex: postman.setNextRequest("yourSecondFolderFirstRequest")