10up / wpacceptance

ARCHIVED: A team scalable solution for reliable WordPress acceptance testing.
https://wpacceptance.readthedocs.io/
MIT License
148 stars 15 forks source link

Enable support for multiple snapshots #3

Closed adamsilverstein closed 5 years ago

adamsilverstein commented 5 years ago

Summary

WP Acceptance runs tests against a snapshot which is configured with the environment we want to test again. For many plugins, we'll actually want to test against multiple environments. For example, on the Distributor plugin where we are using WP Acceptance, we would like to test against WordPress 4.9 and 5.0, with or without the Gutenberg plugin enabled, with or without the Classic Editor plugin enabled. By testing against every environment, we can ensure changes made for one configuration don't break other configurations.

Desired Behavior

Current Behavior

WP Acceptance only accepts a single snapshot id, making it difficult to to test against multiple configurations.

tlovett1 commented 5 years ago

This all sounds right to me. Somehow this will have to coexist with #5