Open nathan5x opened 10 months ago
I am also having this issue when using the github action v6
with chrome in CI and when using cypress run
with chrome locally. cypress open
does generate .nyc_output as well as electron in an environment.
chrome 120 cypress 13.6.2 cypress/code-coverage 3.12.15
I got the same issue when I migrated from @cypress/code-coverage
3.12.11
to 3.12.15
via renovate bot. I tried 3.12.12
and it also had the same issue, so the last ok version seems to be 3.12.11
. Interestingly, it is only in docker for me that is an issue. If I run it outside of docker on Mac OS, it works perfectly fine.
I don't currently have a non-Mac setup to try this on anything else, so I have no idea if this is a Mac specific issue or something wider. It is worth noting that the same issue appears on both an M1 Mac and an Intel Mac. It does pass on our GitLab CI/CD, which is running docker images on a kubernetes cluster, so it does seem to suggest it is more Mac specific that is an issue, or at least something to do with Docker Desktop.
Edit: Noticed there is 3.12.18
which seems to work fine for me, so maybe worth upgrading?
For me the answer was this, https://github.com/cypress-io/code-coverage/issues/361#issuecomment-1682684837
Might not be the answer for everyone, but if coverage is being skipped only in one place but works fine in others, possibly the one place is not on a path that gets Istanbul instrumentation in your app?
I got the same issue when I migrated from
@cypress/code-coverage
3.12.11
to3.12.15
via renovate bot. I tried3.12.12
and it also had the same issue, so the last ok version seems to be3.12.11
. Interestingly, it is only in docker for me that is an issue. If I run it outside of docker on Mac OS, it works perfectly fine.I don't currently have a non-Mac setup to try this on anything else, so I have no idea if this is a Mac specific issue or something wider. It is worth noting that the same issue appears on both an M1 Mac and an Intel Mac. It does pass on our GitLab CI/CD, which is running docker images on a kubernetes cluster, so it does seem to suggest it is more Mac specific that is an issue, or at least something to do with Docker Desktop.
Edit: Noticed there is
3.12.18
which seems to work fine for me, so maybe worth upgrading?
I was facing the same issue. In addition to downgrading to action v5, I was also using a custom image (cypress:browsers
) When I switched to ubuntu-latest
(this is in github CI), the code coverage was generated fine.
I'm also facing the same issue. The code gets instrumented when I run the E2E test locally, but not in the GitHub CI. Tried all solutions mentioned above, no dice. Any ide when this will be fixed or how to get around it?
I recently upgraded the Cypress version to
13.6.1
from9.6.x
and the coverage reports stopped working. Followed all the steps mentioned in this guide https://docs.cypress.io/guides/tooling/code-coverage#E2E-code-coverageDebug Log
Coverage failure message
Versions
What is this plugin's version? If this is NOT the latest released version, can you try the latest version, please?
If the plugin worked before in version X but stopped after upgrading to version Y, please try the released versions between X and Y to see where the breaking change was.
What is the Cypress version? -
13.6.1
What is your operating system? -
Mac OS Ventura
What is the shell? -
OMZ
What is the Node version? -
v16.18.1
What is the NPM version? -
8.19.2
How do you instrument your application? Cypress does not instrument web application code, so you must do it yourself. -
Via babel using webpack
When running tests, if you open the web application in a regular browser and open DevTools, do you see
window.__coverage__
object? Can you paste a screenshot?Is there a
.nyc_output
folder? Is there a.nyc_output/out.json
file? Is it empty? Can you paste at least part of it so we can see the keys and file paths? -it is empty
Do you have any custom NYC settings in
package.json
(nyc
object) or in other NYC config files? -No
Do you run Cypress tests in a Docker container? -
The issue is happening in both Mac OS and Linux based Docker Containers.
Here is some additional information
cypress.config.ts
filecypress/plugins/index.js
filecypress/support/e2e.ts
fileAny help is appreciated.
Thanks, Nathan