[ ] Real user of Poet Assistant
[x] Student or researcher
[ ] Reporting an issue found by a software analysis or automation tool
[ ] Other: Please explain
Hello, we are a group of researchers that investigate the occurrence of flaky tests in Android.
We voluntarily ran your GUI tests 12 times and found that some tests pass or fail non-deterministically, which characterizes them as flaky tests [1]. Below we list each flaky test we found, and its number of failures.
Required before filing an issue:
I am a:
[ ] Real user of Poet Assistant [x] Student or researcher [ ] Reporting an issue found by a software analysis or automation tool [ ] Other: Please explain
Hello, we are a group of researchers that investigate the occurrence of flaky tests in Android.
We voluntarily ran your GUI tests 12 times and found that some tests pass or fail non-deterministically, which characterizes them as flaky tests [1]. Below we list each flaky test we found, and its number of failures.
We ran these tests on a generic Android Emulator (AVD) with Android API version 28.
If you confirm this behavior, our suggestion is to add the
@FlakyTestannotation on these tests. See https://developer.android.com/reference/androidx/test/filters/FlakyTestIf you wish for a repair proposal, please let us know.
[1] https://hackernoon.com/flaky-tests-a-war-that-never-ends-9aa32fdef359
Graciously, Denini, Leopoldo and Marcelo.