search

fsprojects / Canopy.Mobile

Canopy testing framework for mobile apps
https://fsprojects.github.io/Canopy.Mobile/
MIT License
14 stars 12 forks source link

Fight flakiness #15

Closed forki closed 7 years ago

forki commented 7 years ago

Currently this testsuite still fails on our internal gitlab for timing issues. I assume we need to wait until the app is uploaded after every test. @lefthandedgoat us this possible?

lefthandedgoat commented 7 years ago

I suspect it is, but I need to get it so I can launch the emulator from the code locally so I can try stuff out. Still stuck on that one.

forki commented 7 years ago

what is the concrete error when you run build.cmd?

forki commented 7 years ago

ok seems I found the issue for the flakiness in build. If the emulator is started with -no-window (headless mode) then android back button doesn't work

forki commented 7 years ago

http://stackoverflow.com/questions/41363912/press-android-back-button-with-appium-in-no-window-mode

forki commented 7 years ago

/cc @part-timeDev

forki commented 7 years ago

unfortunately this confused the build server and it's now hanging forever.

forki commented 7 years ago

let's see if 77cd0b72e81b510c76ab81654faac90c949d6322 helps with the hanging processes

forki commented 7 years ago

Ok it seems the hanging problem is fixed, but unfortunately I get "GL error while resizing" on the CI an the back button is still not working. It definetly is working on my laptop in non-headless mode. So the question is: what is happening on the CI?

forki commented 7 years ago

seems the error is related to screen resolution: http://stackoverflow.com/questions/39574264/android-gl-error-while-resizing-0x506-ignored

forki commented 7 years ago

Ok. the back button is available in headless mode. Everything was a timing issue and is now resolved. I will add some helpers for animations to make that easier

lefthandedgoat commented 7 years ago

What resolution is the build machine? If its running the worker agent as a windows services then I believe it is only 1024x768 and you have to change your setup to get it to work at a higher resolution.

You have to have the agent run from a DOS window on startup (if the CI server you are using has that option, which allows the resolution to be higher.

Instructions for TeamCity: https://gist.github.com/lefthandedgoat/9138759

forki commented 7 years ago

resolution issue was fixed since we go headless again ;-)