[Android] Improve reliability of UI tests running on CI emulator

jonnyandrew commented 10 months ago

Changes

Add new rules to help tests pass on the Github CI emulator:
- DismissAnrRule dismisses any 'app not responding' dialog present at the start of a test case.
- RetryOnFailureRule retries a failed test once. This is useful if the ANR dialog appeared during the test run.
Add :test module containing shared test utilities

Test runs

:white_check_mark: Attempt 1
:white_check_mark: Attempt 2

Context

Closes #870

codecov-commenter commented 10 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (97e3c85) 89.44% compared to head (14b7631) 87.28%.

Additional details and impacted files

```diff @@ Coverage Diff @@ ## main #872 +/- ## ============================================ - Coverage 89.44% 87.28% -2.16% - Complexity 0 406 +406 ============================================ Files 118 133 +15 Lines 16898 17355 +457 Branches 635 402 -233 ============================================ + Hits 15114 15148 +34 - Misses 1760 1937 +177 - Partials 24 270 +246 ``` | [Flag](https://app.codecov.io/gh/matrix-org/matrix-rich-text-editor/pull/872/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=matrix-org) | Coverage Δ | | |---|---|---| | [uitests](https://app.codecov.io/gh/matrix-org/matrix-rich-text-editor/pull/872/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=matrix-org) | `65.58% <ø> (-13.20%)` | :arrow_down: | | [uitests-android](https://app.codecov.io/gh/matrix-org/matrix-rich-text-editor/pull/872/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=matrix-org) | `65.58% <ø> (?)` | | | [uitests-ios](https://app.codecov.io/gh/matrix-org/matrix-rich-text-editor/pull/872/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=matrix-org) | `?` | | | [unittests](https://app.codecov.io/gh/matrix-org/matrix-rich-text-editor/pull/872/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=matrix-org) | `86.64% <ø> (-1.43%)` | :arrow_down: | | [unittests-android](https://app.codecov.io/gh/matrix-org/matrix-rich-text-editor/pull/872/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=matrix-org) | `45.56% <ø> (?)` | | | [unittests-ios](https://app.codecov.io/gh/matrix-org/matrix-rich-text-editor/pull/872/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=matrix-org) | `?` | | | [unittests-rust](https://app.codecov.io/gh/matrix-org/matrix-rich-text-editor/pull/872/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=matrix-org) | `89.39% <ø> (ø)` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=matrix-org#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.