github-actions[bot] commented 1 year ago

Release OpenSearch and OpenSearch Dashboards 1.3.14

I noticed that a manifest was automatically created in manifests/1.3.14. Please follow the following checklist to make a release.

How to use this issue

## This Release Issue This issue captures the state of the OpenSearch release, its assignee (Release Manager) is responsible for driving the release. Please contact them or @mention them on this issue for help. There are linked issues on components of the release where individual components can be tracked. For more information check the the [Release Process OpenSearch Guide](https://github.com/opensearch-project/opensearch-build/blob/main/RELEASE_PROCESS_OPENSEARCH.md).

Please refer to the following link for the release version dates: Release Schedule and Maintenance Policy.

Preparation

[x] Release manager assigned.
[x] Existence of label in each component repo. For more information check the release-label section.
[x] Increase the build frequency.
[x] Release Issue.

Release Branch and Version Increment - _Ends Dec 1st

Feature Freeze - _Ends Dec 5th

[x] OpenSearch / OpenSearch-Dashboards core and components teams finalize their features.

Code Complete - _Ends Dec 5th

[x] Mark this as done once the Code Complete is reviewed.
[x] Create/Verify pull requests to add each component to relase input manifests/1.3.14/opensearch-1.3.14.yml and manifests/1.3.14/opensearch-dashboards-1.3.14.yml.

Release Candidate Creation and Testing - _Ends Dec 6th

[x] Generate Release Candidate.
[x] Integ Test TAR.
[x] Integ Test RPM.
[x] Docker Build and Scan.
[x] Backwards Compatibility Tests.
[ ] Windows Integration Test.
[x] Broadcast and Communication.
[x] Release Candidate Lock.
[ ] Post the benchmark-tests
[ ] Longevity tests do not show any issues.

Pre Release - _Ends Dec 11th

Release - _Ends Dec 12th

[x] Maven Promotion.
[x] Docker Promotion.
[x] Release Validation.
[x] Collaboration with the Project Management Team.

Release Checklist.

Release Checklist

### Pre-Release activities - [ ] Promote Repos. - - [ ] OS - - [ ] OSD - [ ] Promote Artifacts. - - [ ] Windows - - [ ] Linux Debian - - [ ] Linux RPM - - [ ] Linux TAR - [ ] Consolidated Release Notes. ### Release activities - [ ] Docker Promotion. - [ ] Release Validation part 1. - - [ ] OpenSearch and OpenSearch Dashboard Validation. - - [ ] Validate the native plugin installation. - [ ] Merge consolidated release notes PR. - [ ] Website and Documentation Changes. - - [ ] Merge staging website PR. - - [ ] Promote the website changes to prod. - - [ ] Add website alert. - [ ] Release Validation part 2. - - [ ] Validate the artifact download URL's and signatures. - [ ] Release Validation part 3. - - [ ] Trigger the validation build (Search for `Completed validation for <>` in the logs). - [ ] Maven Promotion. - [ ] Publish blog posts. - [ ] Advertise on Social Media. - [ ] Post on public slack and Github Release issue. ### Post-Release activities - [ ] Release Tags. - [ ] Input Manifest Update. - [ ] Decrease the Build Frequency. - [ ] OpenSearch Build Release notes. - [ ] Retrospective Issue. - [ ] Helm and Ansible Playbook release. - [ ] Upcoming Release Preparation.

Post Release

Components

Replace with links to all component tracking issues.

Component	On track	Release Notes
{COMPONENT_ISSUE_LINK}	{INDICATOR}}	{STATUS}

Legend

| Symbol | Meaning | | -------- | ---------- | | :green_circle: | On track with overall release | | :yellow_circle: | Missed last milestone | | :red_circle: | Missed multiple milestones |

Divyaasm commented 11 months ago

Release manager will be assigned soon. thanks

peternied commented 10 months ago

I'm in the process of backporting a fix in both OpenSearch & Security Plugin - that is being tracked with [1]. This is a sizable change as it includes a significant update to our test infrastructure and a sizable refactor that supports the fix. With the 2.11.1 release there has been discussion on how we make this call - who can I work with to determine if this fix should be part of 1.3.14 vs shipping a 1.4.0 release?

[1] https://github.com/opensearch-project/security/issues/3559

zelinh commented 10 months ago

I don't think we have any plan to ship a 1.4.0 release since for 1.x we are only patching on 1.3. Could you help look into this? @bbarani

I'm in the process of backporting a fix in both OpenSearch & Security Plugin - that is being tracked with [1]. This is a sizable change as it includes a significant update to our test infrastructure and a sizable refactor that supports the fix. With the 2.11.1 release there has been discussion on how we make this call - who can I work with to determine if this fix should be part of 1.3.14 vs shipping a 1.4.0 release?

[1] [Backport 1.3] Add early rejection from RestHandler for unauthorized requests security#3559

bbarani commented 10 months ago

Yes, we currently do not have plans to release 1.4.0 version as its already on maintenance window.

zelinh commented 9 months ago

I'm looking into those commits in the security plugin. They are mostly bug fixes on 1.3 branch. Since we entered the maintenance windows for 1.3.x, bug fixes and CVE fixes should be all included as part of this. I believe we can ship those fixes from Security plugin in this upcoming 1.3.14 patch release. Ref: https://opensearch.org/releases.html

opensearch-ci-bot commented 9 months ago

OpenSearch Dashboards CommitID(after 2023-09-21) & Release Notes info

Repo	Branch	CommitID	Commit Date	Release Notes Exists
alertingDashboards	[7937896ee07160cb4e1fffec989ff64c60c64fa6]	7937896	2023-11-30	False
anomalyDetectionDashboards	[4cb5ec5e3d3b234036b1fff1be65186293aefba7]	4cb5ec5	2023-11-30	False
functionalTestDashboards	[9fc625b491f39e1682d9fb67ebd862537b103969]	9fc625b	2023-12-01	False
ganttChartDashboards	[99b9779c0c167d41a53add2c1681ac9968c389c2]	99b9779	2023-11-30	False
indexManagementDashboards	[762c086503368b5aa26b3c3e7fe9413aaaaec77f]	762c086	2023-11-30	False
observabilityDashboards	[ba3458981e3f2f08950a774a3e2f27e2cdd04885]	ba34589	2023-11-30	False
queryWorkbenchDashboards	[95231a70357834240b3169491a8ce35c36fff0cf]	95231a7	2023-11-30	False
reportsDashboards	[fb6e305fff5893c8820cad97a353465dcfc1edc6]	fb6e305	2023-11-30	False
securityDashboards	[307c7a0674ad1d15fe575a3dbf0a3a7213634099]	307c7a0	2023-12-08	True

opensearch-ci-bot commented 9 months ago

OpenSearch CommitID(after 2023-09-21) & Release Notes info

Repo	Branch	CommitID	Commit Date	Release Notes Exists
alerting	[5f67ea58d9489b8ad9fc06d4f89d347727e5fe9e]	5f67ea5	2023-11-30	False
anomaly-detection	[97efd1ef35d33f60c2edf6b9dcbf81ce808693e6]	97efd1e	2023-10-10	False
asynchronous-search	[f4d500419482e0a53cf35a34cd8864e5f0864d96]	f4d5004	2023-12-01	False
common-utils	[02d6bfdc3113e2aeb9a52dd108144948dabe81b9]	02d6bfd	2023-10-11	False
cross-cluster-replication	[1294d44e572a250673a30328e8bf0a1ea0c295b5]	1294d44	2023-12-01	False
index-management	[71db6ce79dcdf1dada24c07303cff5e2aee997e2]	71db6ce	2023-12-01	False
job-scheduler	[ed410027d243b764b623be1c76dd6ded55e6fd19]	ed41002	2023-09-27	False
k-NN	[2740d97374ba559526b0c07df0bb31384f70cb2b]	2740d97	2023-12-01	False
ml-commons	[143048f718128e6bc0d0b5413055abadb7721b38]	143048f	2023-11-17	False
opensearch-observability	[a72f824b7e4165765152c4ebd4c47e98d6b8c94e]	a72f824	2023-11-30	False
opensearch-reports	[e68a5a38240f0f26d34bcad38c1cd0de8c7ada95]	e68a5a3	2023-11-30	False
performance-analyzer	[5ee85f736d0c6dc3ab45e7a0a57c612bf25c2ad4]	5ee85f7	2023-10-10	False
security	[8924b34f9132297bfbd49fe447f2338b13a95108]	8924b34	2023-12-08	True
sql	[1e4d12efb7ae37c4dc9b792336322e69dbb2a177]	1e4d12e	2023-12-04	False

zelinh commented 9 months ago

We have a new RC in the comment below.

This is an old RC. Please refer to the comment below.

### Release testing We have release candidates built and ready for testing. __________________________________________________________________________________________________________ [OpenSearch Docker](https://hub.docker.com/layers/opensearchstaging/opensearch/1.3.14.8992/images/sha256-dfe3ceff77e67368976e8626d5319facb0c1002dbc525c4d7944250a4978a99b?context=explore) Start without security Docker command docker pull `docker pull opensearchstaging/opensearch:1.3.14.8992 && docker run -it -d -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:1.3.14.8992` Connect command `curl http://localhost:9200` Start with security Docker command `docker pull opensearchstaging/opensearch:1.3.14.8992 && docker run -it -d -p 9200:9200 -e "discovery.type=single-node" opensearchstaging/opensearch:1.3.14.8992` Connect command `curl --insecure https://admin:admin@localhost:9200` [OpenSearch Dashboards Docker](https://hub.docker.com/layers/opensearchstaging/opensearch-dashboards/1.3.14.6910/images/sha256-ac22e7c45c93565fca6d23a8fa9a977ef5f271bc5bca75d7eda8b95115cdefd7?context=explore) Start without security Docker command `docker pull opensearchstaging/opensearch-dashboards:1.3.14.6910 && docker run -it -d --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:1.3.14.6910` URL `http://localhost:5601` Start with security Docker command `docker pull opensearchstaging/opensearch-dashboards:1.3.14.6910 && docker run -it -d --network="host" opensearchstaging/opensearch-dashboards:1.3.14.6910` URL `http://localhost:5601` #### **Use Docker-Compose to setup a cluster** Download this [gist](https://gist.github.com/zelinh/71aa1c5886a5f354e46681bc79ef8975) as docker-compose.yml on your machine Get latest image versions docker-compose pull Start the cluster docker-compose up ## Use below artifacts to deploy OpenSearch and OpenSearch Dashboards on different platforms [OpenSearch - Build 8992](https://build.ci.opensearch.org/job/distribution-build-opensearch/8992/) x64 artifacts: [[manifest](https://ci.opensearch.org/ci/dbc/distribution-build-opensearch/1.3.14/8992/linux/x64/tar/dist/opensearch/manifest.yml)] [[tar](https://ci.opensearch.org/ci/dbc/distribution-build-opensearch/1.3.14/8992/linux/x64/tar/dist/opensearch/opensearch-1.3.14-linux-x64.tar.gz)] [[rpm](https://ci.opensearch.org/ci/dbc/distribution-build-opensearch/1.3.14/8992/linux/x64/rpm/dist/opensearch/opensearch-1.3.14-linux-x64.rpm)] [[yum](https://ci.opensearch.org/ci/dbc/distribution-build-opensearchnote/1.3.14/8992/linux/x64/rpm/dist/opensearch/opensearch-1.3.14.staging.repo)] [[windows](https://ci.opensearch.org/ci/dbc/distribution-build-opensearch/1.3.14/8992/windows/x64/zip/dist/opensearch/opensearch-1.3.14-windows-x64.zip)] arm64 artifacts: [[manifest](https://ci.opensearch.org/ci/dbc/distribution-build-opensearch/1.3.14/8992/linux/arm64/tar/dist/opensearch/manifest.yml)] [[tar](https://ci.opensearch.org/ci/dbc/distribution-build-opensearch/1.3.14/8992/linux/arm64/tar/dist/opensearch/opensearch-1.3.14-linux-arm64.tar.gz)] [[rpm](https://ci.opensearch.org/ci/dbc/distribution-build-opensearch/1.3.14/8992/linux/arm64/rpm/dist/opensearch/opensearch-1.3.14-linux-arm64.rpm)] [[yum](https://ci.opensearch.org/ci/dbc/distribution-build-opensearch/1.3.14/8992/linux/arm64/rpm/dist/opensearch/opensearch-1.3.14.staging.repo)] [OpenSearch Dashboards - Build 6910](https://build.ci.opensearch.org/job/distribution-build-opensearch-dashboards/6910/) x64 artifacts: [[manifest](https://ci.opensearch.org/ci/dbc/distribution-build-opensearch-dashboards/1.3.14/6910/linux/x64/tar/builds/opensearch-dashboards/manifest.yml)] [[tar](https://ci.opensearch.org/ci/dbc/distribution-build-opensearch-dashboards/1.3.14/6910/linux/x64/tar/dist/opensearch-dashboards/opensearch-dashboards-1.3.14-linux-x64.tar.gz)] [[rpm](https://ci.opensearch.org/ci/dbc/distribution-build-opensearch-dashboards/1.3.14/6910/linux/x64/rpm/dist/opensearch-dashboards/opensearch-dashboards-1.3.14-linux-x64.rpm)] [[yum](https://ci.opensearch.org/ci/dbc/distribution-build-opensearch-dashboards/1.3.14/6910/linux/x64/rpm/dist/opensearch-dashboards/opensearch-dashboards-1.3.14.staging.repo)] [[windows](https://ci.opensearch.org/ci/dbc/distribution-build-opensearch-dashboards/1.3.14/6910/windows/x64/zip/dist/opensearch-dashboards/opensearch-dashboards-1.3.14-windows-x64.zip)] arm64 artifacts: [[manifest](https://ci.opensearch.org/ci/dbc/distribution-build-opensearch-dashboards/1.3.14/6910/linux/arm64/tar/builds/opensearch-dashboards/manifest.yml)] [[tar](https://ci.opensearch.org/ci/dbc/distribution-build-opensearch-dashboards/1.3.14/6910/linux/arm64/tar/dist/opensearch-dashboards/opensearch-dashboards-1.3.14-linux-arm64.tar.gz)] [[rpm](https://ci.opensearch.org/ci/dbc/distribution-build-opensearch-dashboards/1.3.14/6910/linux/arm64/rpm/dist/opensearch-dashboards/opensearch-dashboards-1.3.14-linux-arm64.rpm)] [[yum](https://ci.opensearch.org/ci/dbc/distribution-build-opensearch-dashboards/1.3.14/6910/linux/arm64/rpm/dist/opensearch-dashboards/opensearch-dashboards-1.3.14.staging.repo)]

zelinh commented 9 months ago

Release testing

We have release candidates built and ready for testing.

OpenSearch Docker

Start without security Docker command docker pull docker pull opensearchstaging/opensearch:1.3.14.8997 && docker run -it -d -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:1.3.14.8997 Connect command curl http://localhost:9200

Start with security Docker command docker pull opensearchstaging/opensearch:1.3.14.8997 && docker run -it -d -p 9200:9200 -e "discovery.type=single-node" opensearchstaging/opensearch:1.3.14.8997 Connect command curl --insecure https://admin:admin@localhost:9200

OpenSearch Dashboards Docker

Start without security Docker command docker pull opensearchstaging/opensearch-dashboards:1.3.14.6914 && docker run -it -d --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:1.3.14.6914 URL http://localhost:5601

Start with security Docker command docker pull opensearchstaging/opensearch-dashboards:1.3.14.6914 && docker run -it -d --network="host" opensearchstaging/opensearch-dashboards:1.3.14.6914 URL http://localhost:5601

Use Docker-Compose to setup a cluster

Download this gist as docker-compose.yml on your machine Get latest image versions docker-compose pull Start the cluster docker-compose up

Use below artifacts to deploy OpenSearch and OpenSearch Dashboards on different platforms

OpenSearch - Build 8997

x64 artifacts: [manifest] [tar] [rpm] [yum] [windows]

arm64 artifacts: [manifest] [tar] [rpm] [yum]

OpenSearch Dashboards - Build 6914

x64 artifacts: [manifest] [tar] [rpm] [yum] [windows]

arm64 artifacts: [manifest] [tar] [rpm] [yum]

zelinh commented 9 months ago

Integ test results

Tarball arm64: https://build.ci.opensearch.org/job/integ-test/6599/artifact/test-report.yml/*view*/

  - name: index-management
      - name: with-security
        status: FAIL
      - name: without-security
        status: PASS
  - name: anomaly-detection
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS
  - name: asynchronous-search
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS
  - name: alerting
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS
  - name: sql
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS
  - name: k-NN
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS
  - name: opensearch-reports
      - name: without-security
        status: PASS
  - name: opensearch-observability
      - name: without-security
        status: PASS
  - name: ml-commons
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS

Tarball x64: https://build.ci.opensearch.org/job/integ-test/6600/artifact/test-report.yml/*view/ https://build.ci.opensearch.org/job/integ-test/6601/artifact/test-report.yml/view*/

  - name: index-management
      - name: with-security
        status: PASS
      - name: without-security
        status: FAIL
  - name: anomaly-detection
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS
  - name: asynchronous-search
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS
  - name: alerting
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS
  - name: sql
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS
  - name: k-NN
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS
  - name: opensearch-reports
      - name: without-security
        status: PASS
  - name: opensearch-observability
      - name: without-security
        status: PASS
  - name: ml-commons
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS

zelinh commented 9 months ago

Integ test results for OSD

tarball x64: https://build.ci.opensearch.org/job/integ-test-opensearch-dashboards/4726/artifact/test-report.yml/*view*/

  - name: anomalyDetectionDashboards
      - name: with-security
        status: FAIL
      - name: without-security
        status: PASS
  - name: ganttChartDashboards
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS
  - name: observabilityDashboards
      - name: with-security
        status: FAIL
      - name: without-security
        status: PASS
  - name: alertingDashboards
      - name: with-security
        status: FAIL
      - name: without-security
        status: FAIL
  - name: indexManagementDashboards
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS
  - name: reportsDashboards
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS
  - name: securityDashboards
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS
  - name: queryWorkbenchDashboards
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS

tarball arm64: https://build.ci.opensearch.org/job/integ-test-opensearch-dashboards/4727/artifact/test-report.yml/*view/ https://build.ci.opensearch.org/job/integ-test-opensearch-dashboards/4730/artifact/test-report.yml/view*/

  - name: anomalyDetectionDashboards
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS
  - name: ganttChartDashboards
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS
  - name: observabilityDashboards
      - name: with-security
        status: FAIL
      - name: without-security
        status: PASS
  - name: alertingDashboards
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS
  - name: indexManagementDashboards
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS
  - name: reportsDashboards
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS
  - name: securityDashboards
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS
  - name: queryWorkbenchDashboards
      - name: with-security
        status: PASS
      - name: without-security
        status: PASS

zelinh commented 9 months ago

Native plugin can be installed successfully.

 % ./opensearch-plugin install repository-s3
-> Installing repository-s3
-> Downloading repository-s3 from opensearch
[=================================================] 100%
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@     WARNING: plugin requires additional permissions     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
* java.lang.RuntimePermission accessDeclaredMembers
* java.lang.RuntimePermission getClassLoader
* java.lang.reflect.ReflectPermission suppressAccessChecks
* java.net.NetPermission setDefaultAuthenticator
* java.net.SocketPermission * connect,resolve
* java.util.PropertyPermission opensearch.allow_insecure_settings read,write
See http://docs.oracle.com/javase/8/docs/technotes/guides/security/permissions.html
for descriptions of what these permissions allow and the associated risks.

Continue with installation? [y/N]y
-> Installed repository-s3 with folder name repository-s3

zelinh commented 9 months ago

Maven is available https://aws.oss.sonatype.org/content/repositories/releases/org/opensearch/opensearch-core/1.3.14/

gaiksaya commented 9 months ago

1.3.14 has been released. All related post release activities are complete now. Closing this issue. Please see #4281 for adding feedback.

Thanks!

opensearch-project / opensearch-build

[RELEASE] Release version 1.3.14 #4069

Release OpenSearch and OpenSearch Dashboards 1.3.14

Preparation

Release Branch and Version Increment - _Ends Dec 1st

Feature Freeze - _Ends Dec 5th

Code Complete - _Ends Dec 5th

Release Candidate Creation and Testing - _Ends Dec 6th

Pre Release - _Ends Dec 11th

Release - _Ends Dec 12th

Release Checklist.

Post Release

Components

OpenSearch Dashboards CommitID(after 2023-09-21) & Release Notes info

OpenSearch CommitID(after 2023-09-21) & Release Notes info

Release testing

Use Docker-Compose to setup a cluster

Use below artifacts to deploy OpenSearch and OpenSearch Dashboards on different platforms