"Orchestrator like" execution mode

gojuno / composer

Reactive Android Instrumentation Test Runner. Archived. Marathon is recommended as an alternative (https://github.com/Malinskiy/marathon).

Apache License 2.0

546 stars 45 forks source link

"Orchestrator like" execution mode #135

Closed tagantroy closed 5 years ago

tagantroy commented 6 years ago

I would like to execute all tests one by one in different processes as Orchestrator does it. We can extract all tests names with dex-test-parser and execute tests one by one, in this case we will have valid instrumentation output(@artem-zinnatullin mentioned problems with instrumentation output of orchestrator). Pros: clean heap for each test Cons: broken @Parameterized tests

artem-zinnatullin commented 6 years ago

I'm chatting with @yunikkk about it, but so far I'm 100% down for it!

I'd like to make it a default mode of running tests, but also configurable:

Option to clear app data between test executions
Option to disable this mode completely (might be helpful for those who use dynamic test frameworks or parametrized/etc)

artem-zinnatullin commented 6 years ago

@tagantroy let's start small?

PR with parsing tests from --test-apk would be great to begin with :)

artem-zinnatullin commented 6 years ago

cc @dsvoronin

tagantroy commented 6 years ago

@artem-zinnatullin yes, sure. I'll start on this weekend.

dsvoronin commented 6 years ago

Add me as reviewer please, @tagantroy . And i'll be happy to add next things on top of it.

evgengal commented 6 years ago

Any news on this issue?