WordPress / gutenberg

The Block Editor project for WordPress and beyond. Plugin is available from the official repository.
https://wordpress.org/gutenberg/
Other
10.57k stars 4.22k forks source link

Mobile: Flaky unit test #63665

Open Mamaduka opened 4 months ago

Mamaduka commented 4 months ago

The following React Native test seems to be flaky - Gutenberg Editor Rendering Media Blocks test > should be able to render blocks correctly.

It usually passed after restarting the tests.

cc @WordPress/native-mobile

Test file: packages/react-native-editor/__device-tests__/gutenberg-editor-rendering-media-blocks.test.js. Failed run:

Screenshot

CleanShot 2024-07-17 at 17 44 26

dcalhoun commented 2 months ago

Noting that this flaky test outcome appears to also occur for other tests as well, not just the media blocks test suite. I have observed the flaky failure in both the "text" and "other" blocks test suites. My presumption is that it stems from poor performance, which is more common on emulators run on the CI server.

Apologies for any disruption these flaky tests cause for contributors. We appreciate your patience. The mobile team is currently focused on different areas at this time, I am uncertain as to when we will improve the E2E test stability on Android.

cc @geriux

Mamaduka commented 2 months ago

Thanks for the update, @dcalhoun!