search

gojuno / composer

Reactive Android Instrumentation Test Runner. Archived. Marathon is recommended as an alternative (https://github.com/Malinskiy/marathon).
Apache License 2.0
546 stars 45 forks source link

Dynamic and pluggable flaky test handling. #145

Open artem-zinnatullin opened 6 years ago

artem-zinnatullin commented 6 years ago

Composer should be able to handle test flakiness dynamically and provide several default strategies (retry n times, put to the end of queue again, etc).

User should be able to customize behavior with parameters and/or plugin.

emartynov commented 5 years ago

We use barista for that but would be nice to have it in composer

Sloy commented 4 years ago

We use Barista for that too (actually, we built Barista for that 😄). But I think it's a good idea to handle this from the test runner itself. Our Barista rules are kind of hacky, they might break the test if not used properly.