cypress-io / cypress

Fast, easy and reliable testing for anything that runs in a browser.
https://cypress.io
MIT License
47.07k stars 3.19k forks source link

Cypress Test Occasionally Fails Due to Minor Image Differences With Animation Disabled #29144

Open DanielGumbs opened 8 months ago

DanielGumbs commented 8 months ago

Current behavior

During the execution of our Cypress test suite, occasional failures occur where tests fail due to minor differences in the same images. Even with animations disabled, these differences seem to occur, undermining the consistency of our test results. These inconsistencies disrupt the reliability of our testing process and make it challenging to trust the test outcomes for validating our application's functionality.

Base Snapshot: before_page_47-base

Actual Snapshot: before_page_47-actual

Diff Snapshot: before_page_47-diff

Desired behavior

The Cypress tests should consistently pass or fail based on the expected behavior of the application under test. Minor differences in the same images, especially with animations disabled, should not cause test failures.

Test code to reproduce

image

Cypress Version

13.6.4

Node version

20.11.1

Operating System

Windows 10.0.19044.1889

Debug Logs

No response

Other

No response

derekhe commented 7 months ago

+1

tgelu commented 6 months ago

+1

cypress-app-bot commented 1 week ago

This issue has not had any activity in 180 days. Cypress evolves quickly and the reported behavior should be tested on the latest version of Cypress to verify the behavior is still occurring. It will be closed in 14 days if no updates are provided.

tgelu commented 6 days ago

still an issue