Running Cypress locally fails

evenstensberg commented 2 months ago

Summary of the bug

All cypress test locally fail.

🪜 How to reproduce

Tell us the steps to reproduce the problem:

Clone the repo
Install & bootstrap (npm i. && npm run bootstrap && npm run build:all && npm run test-cypress)
When test-cypress runs, the first unit tests work, but when comparing visually all fails.

📸 Screenshots or code

🖥 📱 Device

Type: Desktop
Device: MacBook Pro M2
OS version: Sonoma 14.5
Browser version: Google Chrome - Version 126.0.6478.127 (Official Build) (arm64)

🧐 Expected behaviour

All UI tests should pass

📝 Acceptance Criteria

Given Cypress tests When Running them tests Then it should show all pass-es

Additional info

Tried using different devices, such as Ubuntu, but the bug still persists.
Tried re-cloning repo with fresh build
Tried changing the test platform (i.e just chrome)
Tried main branch, develop branch, error still persists
https://stackoverflow.com/a/78208168

jd239 commented 2 weeks ago

Hi @evenstensberg. When the visual regression fails, a HTML report is generated. In this instance, the report will appear within the react package > cypress-image-diff-html-report. Can you please provide a screenshot of the threshold values which appear for the failed images? This will give us an indication to what needs amending. Thanks.

evenstensberg commented 2 weeks ago

All thresholds fail. This is because on my mac (M2) it generates snapshots to be matched in 500x500 instead of the 1000x1000 as its in the baseline images. Tried on different machines too (ubuntu).

mi6 / ic-ui-kit