opensearch-project / opensearch-build

🧰 OpenSearch / OpenSearch-Dashboards Build Systems
Apache License 2.0
136 stars 271 forks source link

Add automated validation during releases #2524

Open bbarani opened 2 years ago

bbarani commented 2 years ago

Is your feature request related to a problem? Please describe

We are currently doing manual validation for verifying the artifacts, download links and signatures during release process. This is taking additional time and adding manual overhead during release process.

Describe the solution you'd like

Automate the below validation and verification process during OpenSearch releases,

Acceptance criteria:

The automated validation workflow should:

Describe alternatives you've considered

No response

Additional context

Need a cypress test to test the https://opensearch.org/ website clickstream links.

gaiksaya commented 1 year ago

Proposal:

I believe it is better to have a validation framework (something similar to https://github.com/opensearch-project/opensearch-build/blob/main/src/sign_workflow/signer.py) with abstract methods like download, install, start_cluster, run_apis, etc. This will allow us to have a uniform execution mechanism across different platforms like docker, rpm, tarballs, windows, macos, etc. This framework then can be wrapped by a jenkins build library which can be called in CI workflows to run validation after each release. cc: @Divyaasm