search

wix / Detox

Gray box end-to-end testing and automation framework for mobile apps
https://wix.github.io/Detox/
MIT License
11.2k stars 1.92k forks source link

Skip Detox setup for skipped suites (research) #2533

Open d4vidi opened 3 years ago

d4vidi commented 3 years ago

While working on the timeline artifact, I've spotted (using the resulting visualization) an interesting shortcoming Detox has, handling the execution of suites that are altogether skipped (e.g., due to an :ios: marking while running on Android).

Detox (integrating with Jest) is currently not cleaver enough to understand that nothing is going to be executed, and hence nevertheless gets the worker to go through the entire setup process (detox init, app uninstall, reinstall) - which can be very time consuming (especially compared to the ~1ms "execution" time of the suite itself... 😆).

The question is whether using advanced runners such as jest-circus, it'd be possible to identify this state in advance, and skip whatever's unnecessary. Note: need to double check that things like beforeAll and afterAll do not get executed, as well.

@noomorph wdyt? Is it likely to be feasible?

stale[bot] commented 3 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe the issue is still relevant, please test on the latest Detox and report back.

Thank you for your contributions!

For more information on bots in this reporsitory, read this discussion.

noomorph commented 3 years ago

This is a good point, but it is quite challenging to implement at the moment. Maybe when we rewrite to single global Detox server per session.

This issue deserves to be on the radar, but it is too early to throw effort at it.