dropbox / dropshots

Easy on-device screenshot testing for Android.
Apache License 2.0
259 stars 17 forks source link

Text signs are different at same emulators on different machines #63

Closed zhkvdm closed 1 day ago

zhkvdm commented 4 months ago

Letters and digits are different at the tests on local machine and on CI machine. Machines has a different proc architecture. Local machine is M1 arch. CI machine is Intel arch. Zoomed diff image shows red pixels around the symbols. Is symbols generating different depends on proc architecture? How could i have the same screenshots at local and CI machines?

I can use tolerance for screenshots, but different screens contains a different amount of symbols. More symbols needs a large tolerance of screenshot. So I can't select the unique tolerance for every screen.

Снимок экрана 2024-07-04 в 12 59 03
rharter commented 1 month ago

Yes, this is one of the challenges that the [v|h]-shift from differ is meant to deal with. That is a pain, but another option is to generate all screenshots in CI, committing them back into your PR for review from there. I updated this repo to do that, based on something that was done in the Now in Android repository.