cypress-io / cypress

Fast, easy and reliable testing for anything that runs in a browser.
https://cypress.io
MIT License
46.52k stars 3.15k forks source link

Support for multiple browsers in one run #21387

Open jwedel opened 2 years ago

jwedel commented 2 years ago

What would you like?

I would like to configure Cypress like this:

cypress run --browsers chrome,firefox

This would

Why is this needed?

We run Cypress in a cypress docker container to run the tests by Ops on other systems and mount the test results on the hosts file system. I've spent considerable amount of time to do this properly to run Cypress twice and have all test reports properly available on the host.

It would be a lot easier, if cypress would support that out of the box. And I could assume that this is actually a valid use case to run a suite with different browsers

Other

No response

jwedel commented 2 years ago

@mjhenkes Hi, just for my understanding, what does the label "fire watch" mean? Thx

rockhold commented 2 years ago

Hey @jwedel, our "Fire Watch" stage is an internal process we're using to triage incoming issues from the community. We have a group of people representing each of the teams working on the open-source app, and they help to triage, reproduce, and route issues to the team best suited to address them. This issue was routed to my team and came up during a backlog grooming meeting today.

Since we have a pretty active community here on GitHub, sometimes we do miss tags in comments, so I apologize for the delay in getting back to you. The primary focus for a while now (especially this last month) has been in releasing 10.0 and fixing any high-priority issues reported against it. For this specific issue you've logged, it seems appropriate for a product manager to review the proposal. I've flagged it for product review to get it on their radar. You can expect some discussion (likely from @pstakoun soon). For full transparency considering our current roadmap, I thought I'd also call out that this will be a low-priority enhancement request at this time. Product review discussions, or even more interest from the community, however, are things that may impact prioritization, so consider priority to be a pretty fluid thing.

pstakoun commented 2 years ago

@jwedel I'm curious to learn why you need both browsers in a single run, rather than using our provided grouping mechanism via --group to combine runs on multiple browsers into a single run. Alternatively, would it be suitable to simply run something like cypress run --browser chrome && cypress run --browser firefox?

jwedel commented 2 years ago

@pstakoun Thanks for you suggestions. I am really open to find a solution that is already there :)

Also after reading the grouping mechanism, I am not sure how this can be leveraged to call Cypress once and have it output reports and videos for two browsers.

Alternatively, would it be suitable to simply run something like cypress run --browser chrome && cypress run --browser firefox?

Cypress is executed from an image and gets things like which browser to run from the command line. So it's not that easy to do this in a configurable way. Also, wont it overwrite the the result videos e.g.?

csvan commented 2 years ago

You can configure where results are written, or have a simple script move them between runs

manoj-fd commented 1 year ago

Hi @jwedel , I am currently exploring the option to run multiple browser in cypress, just noticed your ticket here, are you able to find any existing solution to support multiple browser, i see few suggestions grouping mechanism and combining cypress runs, would like to understand you got any other solution