search

elastic / kibana

Your window into the Elastic Stack
https://www.elastic.co/products/kibana
Other
19.78k stars 8.18k forks source link

Support for testing with multi-version clusters #105260

Open alisonelizabeth opened 3 years ago

alisonelizabeth commented 3 years ago

Describe the feature: We’d like to have more robust automated test coverage for the Upgrade Assistant. In order to do so, we need the ability to run multi-version clusters, i.e., do X in old version, upgrade cluster, then do Y in new version. Elasticsearch offers similar capabilities with its backwards compatibility tests.

Describe a specific use case for the feature: For the 8.0 Upgrade Assistant, we are supporting upgrading or deleting old Machine Learning snapshots. Currently all tests are written using mocked data (related issue: https://github.com/elastic/kibana/issues/91879).

It’d be great if we could support integration tests where a 6.x cluster could be spun up that would create the old ML snapshots, then upgraded to 7.x. On the 7.x cluster, we can verify that the deprecation is triggered and the Upgrade Assistant successfully resolves it.

elasticmachine commented 3 years ago

Pinging @elastic/kibana-operations (Team:Operations)