opensearch-project / reporting

Export and automate PNG, PDF, and CSV reports in OpenSearch Dashboards
https://opensearch.org/docs/latest/dashboards/reporting/
Apache License 2.0
28 stars 65 forks source link

[FEATURE] Onboard distribution level BWC bundle test #946

Open zelinh opened 7 months ago

zelinh commented 7 months ago

Is your feature request related to a problem? Currently reporting repo has BWC test on plugin level and only tested within the repo. We have a framework for BWC distribution level test available and you could utilize it and enable distribution level BWC test.

With this framework, you would be able to spin up the test cluster with the latest distribution bundle that engineering effectiveness team generated that installs all the other components. This test will be more comprehensive as it will test the exact product we ship to the customers.

Onboarding this distribution level BWC test will enable engineering effectiveness team to run BWC tests every time ee team generates a new bundle distribution through CI.

More onboarding info can be found here: https://github.com/opensearch-project/opensearch-plugins/blob/main/TESTING.md#bwc-tests-on-distribution-bundle-level

What solution would you like? Similar to what we did to the SQL plugin. https://github.com/opensearch-project/sql/pull/1209 Enable bundle level BWC test based on the BWC test you already have.

zelinh commented 1 month ago

Can we get some traction on this issue? This BWC tests request would be a future release blocker.