[v1.33.1] assertVisible is producing false positives in Maestro Studio

clmoore28 commented 11 months ago

Describe the bug Maestro Studio is not failing the assertVisible assertions when the elements do not exist.

To Reproduce

Start the simulator for a React Native project on iOS or Android
Run Maestro Studio
Manually run an assertVisible assertion in the commands box for any ID that does not exist

Expected behavior The command fails.

Screenshots

Environment information (please complete the following information):

Maestro version v1.33.1
Platform: iOS v17.0 & Android v13, but possibly across others.
Framework: React Native
Device model and OS version: All iPhone emulators and Android devices.
Simulator, emulator or physical device: Simulators/emulators and physical devices.
Host [e.g. Mac M1, Windows, Linux, etc]: Mac M1

hackgoofer commented 9 months ago

It is affecting me too

rikur commented 8 months ago

Any assertVisible or assertNotVisible seems to "pass" in Studio

rob4226 commented 6 months ago

Still happening in v1.36.0, it seems every command succeeds in studio when it should really fail.

Related issue #1617.

mobile-dev-inc / maestro