search

iTwin / appui

Monorepo for iTwin.js AppUi
MIT License
8 stars 2 forks source link

Full stack tests failure on mac os #490

Closed ben-polinsky closed 1 month ago

ben-polinsky commented 11 months ago

Describe the bug Running full-stack-tests/ui playwright tests fail on M1 Mac / Ventura 13.2.1.

To Reproduce 1.rush build 2.cd full-stack-tests/ui 3.rushx test

Expected behavior Tests should produce the same result across platforms.

Screenshots

image

Desktop (please complete the applicable information):

raplemie commented 11 months ago

Hi @ben-polinsky, I dont have access to a Mac and the pipelines are running on MacOS, none of the tests are indeed expected to be different on different OS, Not sure how we would go about this.

ben-polinsky commented 11 months ago

I dont have access to a Mac

Which is why I've self-assigned it :)

It also looks like you are not running these tests on a mac in CI?

https://github.com/iTwin/appui/blob/a6164991e307fb86d24be19021014018cdfaf206/common/config/azure-pipelines/templates/core-build.yaml#L81

raplemie commented 11 months ago

Right, we dont run rush test but rush cover on all OS (which do not include fullstack, my bad.

ben-polinsky commented 11 months ago

All good! We'll see when I have time to get to this :)

ben-polinsky commented 11 months ago

Passes on external monitor. Fails on internal macbook monitor. Nah, this is incorrect. Just flaky all around for me.

GerardasB commented 1 month ago

We are running these in a docker environment, which should help with flakiness.