github-actions[bot] commented 6 months ago

Release OpenSearch and OpenSearch Dashboards 2.15.0

I noticed that a manifest was automatically created in manifests/2.15.0. Please follow the following checklist to make a release.

How to use this issue

## This Release Issue This issue captures the state of the OpenSearch release, its assignee (Release Manager) is responsible for driving the release. Please contact them or @mention them on this issue for help. There are linked issues on components of the release where individual components can be tracked. For more information check the the [Release Process OpenSearch Guide](https://github.com/opensearch-project/opensearch-build/wiki/Releasing-the-Distribution).

Please refer to the following link for the release version dates: Release Schedule and Maintenance Policy.

Entrance Criteria

Criteria	Status	Description	Comments
Documentation draft PRs are up and in tech review for all component changes	:green_circle:
Sanity testing is done for all components	:green_circle:
Code coverage has not decreased (all new code has tests)	:green_circle:
Release notes are ready and available for all components	:green_circle:
Roadmap is up-to-date (information is available to create release highlights)	:green_circle:
Release ticket is cut, and there's a forum post announcing the start of the window	:green_circle:
Any necessary security reviews are complete	:green_circle:

OpenSearch 2.15.0 exit criteria status:

Criteria	Status	Description	Comments
Performance tests are run, results are posted to the release ticket and there no unexpected regressions	:green_circle:
No unpatched vulnerabilities of medium or higher severity that have been publicly known for more than 60 days	:green_circle:
Documentation has been fully reviewed and signed off by the documentation community.	:green_circle:
All integration tests are passing	:green_circle:
Release blog is ready	:green_circle:

OpenSearch-Dashboards 2.15.0 exit criteria status:

Criteria	Status	Description	Comments
Documentation has been fully reviewed and signed off by the documentation community	:green_circle:
No unpatched vulnerabilities of medium or higher severity that have been publicly known for more than 60 days	:green_circle:
All integration tests are passing	:green_circle:
Release blog is ready	:green_circle:

Preparation

[x] Release manager assigned.
- @peterzhuamazon
- @zelinh
[x] Update release page on the website with release manager and release issue details. Sample PR
- https://github.com/opensearch-project/project-website/pull/2932
[x] Existence of label in each component repo. For more information check the release-label section.
[x] Increase the build frequency.
- https://github.com/opensearch-project/opensearch-build/pull/4744
[x] Release Issue.

Campaigns

Release Branch and Version Increment - Ends 2024/06/10 4PM PST

Feature Freeze - Ends 2024/06/11 4PM PST

[x] OpenSearch / OpenSearch-Dashboards core and components teams finalize their features.

Code Complete - Ends 2024/06/11 4PM PST

[x] Mark this as done once the Code Complete is reviewed.
[x] Create/Verify pull requests to add each component to relase input manifests/2.15.0/opensearch-2.15.0.yml and manifests/2.15.0/opensearch-dashboards-2.15.0.yml.

Release Candidate Creation and Testing - Starts 2024/06/11 after 4PM

Performance testing validation - Starts 2024/06/11

[x] Post the benchmark-tests
[x] Longevity tests do not show any issues.

Pre Release

[x] Release Labeled Issues.
[x] Go or No-Go.
- https://opensearch.org/events/2024-0625-2-15-release-meetings/
[x] Promote Repos.
[x] Promote artifacts.
[x] Release Notes.
- https://github.com/opensearch-project/opensearch-build/pull/4789

Release - 2024/06/25

[x] Maven Promotion.
[x] Docker Promotion.
[x] Release Validation.
[x] Collaboration with the Project Management Team.

Release Checklist.

Release Checklist

### Pre-Release activities - [x] Promote Repos. - - [x] OS - - [x] OSD - [x] Promote Artifacts. - - [x] Windows - - [x] Linux Debian - - [x] Linux RPM - - [x] Linux TAR - [x] Consolidated Release Notes. * https://github.com/opensearch-project/opensearch-build/pull/4789 ### Release activities - [x] Docker Promotion. - [x] Release Validation part 1. - - [x] OpenSearch and OpenSearch Dashboard Validation. - - [x] Validate the native plugin installation. - [x] Merge consolidated release notes PR. - [x] Website and Documentation Changes. - - [x] Merge staging website PR. * https://github.com/opensearch-project/project-website/pull/3007 - - [x] Promote the website changes to prod. - - [x] Add website alert. * https://github.com/opensearch-project/project-website/pull/3008 - [x] Release Validation part 2. - - [x] Validate the artifact download URL's and signatures. - [x] Release Validation part 3. - - [x] Trigger the validation build (Search for `Completed validation for <>` in the logs). - [x] Maven Promotion. - [x] Publish blog posts. * https://github.com/opensearch-project/project-website/pull/3011 - [x] Advertise on Social Media. - [x] Post on public slack and Github Release issue. ### Post-Release activities - [x] Release Tags. - [x] Input Manifest Update. - [x] Decrease the Build Frequency. - [x] OpenSearch Build Release notes. - [x] Retrospective Issue. * https://github.com/opensearch-project/opensearch-build/issues/4786 - [x] Helm and Ansible Playbook release. * https://github.com/opensearch-project/helm-charts/pull/552 * https://github.com/opensearch-project/opensearch-build/issues/4681 - [x] Upcoming Release Preparation.

Post Release

Components

OpenSearch

Component	Issues tagged with 2.15.0
https://github.com/opensearch-project/OpenSearch/issues/13547
https://github.com/opensearch-project/common-utils/issues/652
https://github.com/opensearch-project/job-scheduler/issues/627
https://github.com/opensearch-project/security/issues/4318
https://github.com/opensearch-project/k-NN/issues/1690
https://github.com/opensearch-project/geospatial/issues/656
https://github.com/opensearch-project/cross-cluster-replication/issues/1384
https://github.com/opensearch-project/ml-commons/issues/2406
https://github.com/opensearch-project/neural-search/issues/732
https://github.com/opensearch-project/notifications/issues/919
https://github.com/opensearch-project/observability/issues/1827
https://github.com/opensearch-project/reporting/issues/997
https://github.com/opensearch-project/sql/issues/2656
https://github.com/opensearch-project/asynchronous-search/issues/570
https://github.com/opensearch-project/anomaly-detection/issues/1204
https://github.com/opensearch-project/alerting/issues/1545
https://github.com/opensearch-project/security-analytics/issues/1018
https://github.com/opensearch-project/index-management/issues/1170
https://github.com/opensearch-project/performance-analyzer/issues/653
https://github.com/opensearch-project/performance-analyzer-rca/issues/550
https://github.com/opensearch-project/custom-codecs/issues/143
https://github.com/opensearch-project/flow-framework/issues/706
https://github.com/opensearch-project/skills/issues/312

OpenSearch Dashboards

Component	Issues tagged with 2.15.0
https://github.com/opensearch-project/OpenSearch-Dashboards/issues/6718
https://github.com/opensearch-project/opensearch-dashboards-functional-test/issues/1269
https://github.com/opensearch-project/dashboards-observability/issues/1820
https://github.com/opensearch-project/dashboards-reporting/issues/352
https://github.com/opensearch-project/dashboards-visualizations/issues/366
https://github.com/opensearch-project/dashboards-query-workbench/issues/322
https://github.com/opensearch-project/dashboards-maps/issues/619
https://github.com/opensearch-project/anomaly-detection-dashboards-plugin/issues/756
https://github.com/opensearch-project/ml-commons-dashboards/issues/327
https://github.com/opensearch-project/index-management-dashboards-plugin/issues/1059
https://github.com/opensearch-project/dashboards-notifications/issues/204
https://github.com/opensearch-project/alerting-dashboards-plugin/issues/948
https://github.com/opensearch-project/security-analytics-dashboards-plugin/issues/1005
https://github.com/opensearch-project/security-dashboards-plugin/issues/1938
https://github.com/opensearch-project/dashboards-search-relevance/issues/393
https://github.com/opensearch-project/dashboards-assistant/issues/189		Ó

Legend

| Symbol | Meaning | | -------- | ---------- | | :green_circle: | On track with overall release | | :yellow_circle: | Missed last milestone | | :red_circle: | Missed multiple milestones |

Issues / PRs:

Links

Bukhtawar commented 5 months ago

Some of the features including Remote Cluster State Publicationand Remote Routing Table have been stalled due to DCO check failures, would be great if we can get some extension and move the Feature Freeze to 06/10 to ensure we have a stable release

peterzhuamazon commented 5 months ago

Some of the features including Remote Cluster State Publicationand Remote Routing Table have been stalled due to DCO check failures, would be great if we can get some extension and move the Feature Freeze to 06/10 to ensure we have a stable release

Hi @Bukhtawar and all,

I have synced up with a few members and seems like it is indeed reasonable to change the original timeline a bit. I will move the freeze time to 06/10 4PM PST and we will start building RC1 after that.

Thanks.

peterzhuamazon commented 5 months ago

Awaiting version bumps:

OpenSearch:

OpenSearch Dashboards:

opensearch-ci-bot commented 5 months ago

Core Components CommitID(after 2024-05-14) & Release Notes info

Repo	Branch	CommitID	Commit Date	Release Notes Exists
OpenSearch	[61dbcd0795c9bfe9b81e5762175414bc38bbcadf]	61dbcd0	2024-06-17	True
alerting	[82fea192437d305dbb1ae07536fee05e8f13ace2]	82fea19	2024-06-18	True
anomaly-detection	[f6d262e2d3a20309adc8ab2bbcb1248defc3a190]	f6d262e	2024-06-12	True
asynchronous-search	[295bd1c831f64906709d6e25b6ad0d9bab2f45fb]	295bd1c	2024-06-12	True
common-utils	[4e407bd981929cb332f708bcf0acc87f9a3beb99]	4e407bd	2024-06-12	True
cross-cluster-replication	[f4af360f50d8335dcbf974001ea577f3b7428e25]	f4af360	2024-06-17	True
custom-codecs	[0d32cb08e8e326a6968b87961f7284311ad301ba]	0d32cb0	2024-06-12	True
flow-framework	[1d01add552ad457074e5bf76a11112b5678c7ba3]	1d01add	2024-06-12	True
geospatial	[ee4289213d72c63fec47758b74ab6c6376c216c9]	ee42892	2024-06-11	True
index-management	[ce7ee04856aeb18a5fa232a802f85b5d97fecc00]	ce7ee04	2024-06-14	True
job-scheduler	[1963c998b0face391dfff8e16d19f5abeea96797]	1963c99	2024-06-12	True
k-NN	[150c589849a8ec3bc442d830b43a3eaf4e25fa0c]	150c589	2024-06-12	True
ml-commons	[0e2718105a82b6a0846894b902607e6a7cf92dac]	0e27181	2024-06-18	True
neural-search	[e683e7455a1091d20ee5903bd115059f147870e3]	e683e74	2024-06-11	True
notifications	[aa9b6c464754f95fdb791ba9d7e29fa9c04293ac]	aa9b6c4	2024-06-12	True
notifications-core	[aa9b6c464754f95fdb791ba9d7e29fa9c04293ac]	aa9b6c4	2024-06-12	True
opensearch-observability	[2ec046b2e324c5de8acb0abb37efde3b4c6d8e0d]	2ec046b	2024-06-11	True
opensearch-reports	[50451382b671ac84081a5e48a3661cf6d1b1434b]	5045138	2024-06-11	True
performance-analyzer	[837bfe8a6ed11eb8a8a8b6ffc0049b8f4984a1b6]	837bfe8	2024-06-17	True
security	[96743013767dd7e57e88de7ef1dae01b9545b01c]	9674301	2024-06-18	True
security-analytics	[c0de31a0e99bfc3ab8201706e4d8d74db8a0f4e6]	c0de31a	2024-06-19	True
skills	[27962077bc0afbb50cf4443c55b8cb81b76ecd85]	2796207	2024-06-14	True
sql	[aa606a944e5b31a32029fc25d3004154e08db197]	aa606a9	2024-06-11	True

opensearch-ci-bot commented 5 months ago

Core Components CommitID(after 2024-05-14) & Release Notes info

Repo	Branch	CommitID	Commit Date	Release Notes Exists
OpenSearch-Dashboards	[aa37a6921f56a6ef6355b5ed8a6bd7b6017aae6a]	aa37a69	2024-06-19	True
alertingDashboards	[1af26aa4b53d5bc8fbb176e3272a211827c116ff]	1af26aa	2024-06-11	True
anomalyDetectionDashboards	[49b35f0849f80f860022d663b5e6746f0e3540ff]	49b35f0	2024-06-12	True
assistantDashboards	[5e7b493f652f59ea83d7a0bb7f1c97127157b74c]	5e7b493	2024-06-07	True
customImportMapDashboards	[7d0affc5498651b1a8f07387d96cac748c37a0f9]	7d0affc	2024-06-11	True
functionalTestDashboards	[2.15]	6530b0f	2024-06-19	False
ganttChartDashboards	[8b042be27cbf88f590d5e1e533504abd04cdbd98]	8b042be	2024-06-11	True
indexManagementDashboards	[ec9725567dee7b688982838a58e09573e61c6e27]	ec97255	2024-06-14	True
mlCommonsDashboards	[c7ace3e3de9fe2475debb2b4c310c025da629a58]	c7ace3e	2024-06-07	True
notificationsDashboards	[aa7e7eff4cd6302442531fb8ca75d781a37084b3]	aa7e7ef	2024-06-11	True
observabilityDashboards	[bc03f8eb322383461d035431b4b1ba0aa67df298]	bc03f8e	2024-06-12	True
queryWorkbenchDashboards	[3a1c75618c676ee7cd318fed5714b324c2aaf127]	3a1c756	2024-06-11	True
reportsDashboards	[ebbee208e9ec348e12dfe23c3f6400d25bca3b50]	ebbee20	2024-06-11	True
searchRelevanceDashboards	[a1a1ed98b71e3721a0a44315f4b46f8733b7787b]	a1a1ed9	2024-06-11	True
securityAnalyticsDashboards	[76baf6b1a600df676900fc0ceda6c1023bcb68ca]	76baf6b	2024-06-12	True
securityDashboards	[2a11d1d9250be6dbc9627374ba3fd86d096d6d17]	2a11d1d	2024-06-12	True

peterzhuamazon commented 5 months ago

We have decided to move the RC1 generation date to 06/11 4PM PST due to:

Here is the website change to reflect the date push:

https://github.com/opensearch-project/project-website/pull/2955

Thanks.

peterzhuamazon commented 5 months ago

RC 1 OpenSearch 9964 / OpenSearch Dashboards 7729 is ready for your test.

OpenSearch - Build 9964 OpenSearch Dashboards - Build 7729

Use the following Docker-Compose to setup a cluster

docker-compose.yml


version: '3'
services:
opensearch-node1:
  image: opensearchstaging/opensearch:2.15.0.9964
  container_name: opensearch-node1
  environment:
    - cluster.name=opensearch-cluster
    - node.name=opensearch-node1
    - discovery.seed_hosts=opensearch-node1,opensearch-node2
    - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
    - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping
    - OPENSEARCH_INITIAL_ADMIN_PASSWORD=${OPENSEARCH_INITIAL_ADMIN_PASSWORD}
  ulimits:
    memlock:
      soft: -1
      hard: -1
    nofile:
      soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems
      hard: 65536
  volumes:
    - opensearch-data1:/usr/share/opensearch/data
  ports:
    - 9200:9200
    - 9600:9600 # required for Performance Analyzer
  networks:
    - opensearch-net
opensearch-node2:
  image: opensearchstaging/opensearch:2.15.0.9964
  container_name: opensearch-node2
  environment:
    - cluster.name=opensearch-cluster
    - node.name=opensearch-node2
    - discovery.seed_hosts=opensearch-node1,opensearch-node2
    - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
    - bootstrap.memory_lock=true
    - OPENSEARCH_INITIAL_ADMIN_PASSWORD=${OPENSEARCH_INITIAL_ADMIN_PASSWORD}
  ulimits:
    memlock:
      soft: -1
      hard: -1
    nofile:
      soft: 65536
      hard: 65536
  volumes:
    - opensearch-data2:/usr/share/opensearch/data
  networks:
    - opensearch-net
opensearch-dashboards:
  image: opensearchstaging/opensearch-dashboards:2.15.0.7729
  container_name: opensearch-dashboards
  ports:
    - 5601:5601
  expose:
    - "5601"
  environment:
    OPENSEARCH_HOSTS: '["https://opensearch-node1:9200","https://opensearch-node2:9200"]'
  networks:
    - opensearch-net
volumes:
opensearch-data1:
opensearch-data2:

networks:
opensearch-net:

Download the above docker-compose.yml on your machine.
Get latest image versions docker-compose pull.
Start the cluster docker-compose up.

OpenSearch docker 2.15.0.9964
- Start without security
  - Docker command docker pull opensearchstaging/opensearch:2.15.0.9964 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.15.0.9964
- Connect command curl http://localhost:9200/
- Start with security
- Docker command docker pull opensearchstaging/opensearch:2.15.0.9964 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "OPENSEARCH_INITIAL_ADMIN_PASSWORD=<custom-admin-password>" opensearchstaging/opensearch:2.15.0.9964
- Connect command curl --insecure https://admin:<custom-admin-password>@localhost:9200/
OpenSearch-Dashboards docker 2.15.0.7729
- Start without security
- Docker command docker pull opensearchstaging/opensearch-dashboards:2.15.0.7729 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:2.15.0.7729
- URL http://localhost:5601/
- Start with security
- Docker command docker pull opensearchstaging/opensearch-dashboards:2.15.0.7729 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:2.15.0.7729
- URL http://localhost:5601/
Use TARs to deploy OpenSearch Manually
- OpenSearch - Build 9964 (Note: Windows version does not have performance analyzer plugin)
- arm64 [manifest] [tar] [rpm][deb]
- x64 [manifest] [tar] [rpm] [deb] [windows]
- OpenSearch Dashboards - Build 7729
- arm64 [manifest] [tar][rpm][deb]
- x64 [manifest] [tar][rpm] [deb] [windows]

Check how to install opensearch and dashboards on different platforms

peterzhuamazon commented 5 months ago

RC2 Changes:

06/12 https://github.com/opensearch-project/opensearch-build/pull/4765

06/13 https://github.com/opensearch-project/opensearch-build/pull/4772

peterzhuamazon commented 4 months ago

RC 2 OpenSearch 9970 / OpenSearch Dashboards 7731 is ready for your test.

OpenSearch - Build 9970 OpenSearch Dashboards - Build 7731

Use the following Docker-Compose to setup a cluster

docker-compose.yml


version: '3'
services:
opensearch-node1:
  image: opensearchstaging/opensearch:2.15.0.9970
  container_name: opensearch-node1
  environment:
    - cluster.name=opensearch-cluster
    - node.name=opensearch-node1
    - discovery.seed_hosts=opensearch-node1,opensearch-node2
    - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
    - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping
    - OPENSEARCH_INITIAL_ADMIN_PASSWORD=${OPENSEARCH_INITIAL_ADMIN_PASSWORD}
  ulimits:
    memlock:
      soft: -1
      hard: -1
    nofile:
      soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems
      hard: 65536
  volumes:
    - opensearch-data1:/usr/share/opensearch/data
  ports:
    - 9200:9200
    - 9600:9600 # required for Performance Analyzer
  networks:
    - opensearch-net
opensearch-node2:
  image: opensearchstaging/opensearch:2.15.0.9970
  container_name: opensearch-node2
  environment:
    - cluster.name=opensearch-cluster
    - node.name=opensearch-node2
    - discovery.seed_hosts=opensearch-node1,opensearch-node2
    - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
    - bootstrap.memory_lock=true
    - OPENSEARCH_INITIAL_ADMIN_PASSWORD=${OPENSEARCH_INITIAL_ADMIN_PASSWORD}
  ulimits:
    memlock:
      soft: -1
      hard: -1
    nofile:
      soft: 65536
      hard: 65536
  volumes:
    - opensearch-data2:/usr/share/opensearch/data
  networks:
    - opensearch-net
opensearch-dashboards:
  image: opensearchstaging/opensearch-dashboards:2.15.0.7731
  container_name: opensearch-dashboards
  ports:
    - 5601:5601
  expose:
    - "5601"
  environment:
    OPENSEARCH_HOSTS: '["https://opensearch-node1:9200","https://opensearch-node2:9200"]'
  networks:
    - opensearch-net
volumes:
opensearch-data1:
opensearch-data2:

networks:
opensearch-net:

Download the above docker-compose.yml on your machine.
Get latest image versions docker-compose pull.
Start the cluster docker-compose up.

OpenSearch docker 2.15.0.9970
- Start without security
  - Docker command docker pull opensearchstaging/opensearch:2.15.0.9970 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.15.0.9970
- Connect command curl http://localhost:9200/
- Start with security
- Docker command docker pull opensearchstaging/opensearch:2.15.0.9970 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "OPENSEARCH_INITIAL_ADMIN_PASSWORD=<custom-admin-password>" opensearchstaging/opensearch:2.15.0.9970
- Connect command curl --insecure https://admin:<custom-admin-password>@localhost:9200/
OpenSearch-Dashboards docker 2.15.0.7731
- Start without security
- Docker command docker pull opensearchstaging/opensearch-dashboards:2.15.0.7731 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:2.15.0.7731
- URL http://localhost:5601/
- Start with security
- Docker command docker pull opensearchstaging/opensearch-dashboards:2.15.0.7731 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:2.15.0.7731
- URL http://localhost:5601/
Use TARs to deploy OpenSearch Manually
- OpenSearch - Build 9970 (Note: Windows version does not have performance analyzer plugin)
- arm64 [manifest] [tar] [rpm][deb]
- x64 [manifest] [tar] [rpm] [deb] [windows]
- OpenSearch Dashboards - Build 7731
- arm64 [manifest] [tar][rpm][deb]
- x64 [manifest] [tar][rpm] [deb] [windows]

Check how to install opensearch and dashboards on different platforms

peterzhuamazon commented 4 months ago

RC3 Changes

06/13 06/14 https://github.com/opensearch-project/opensearch-build/pull/4775 https://github.com/opensearch-project/opensearch-build/pull/4783

shwetathareja commented 4 months ago

@peterzhuamazon What is the process to provide highlight in Release Notes for OpenSearch Core?

peterzhuamazon commented 4 months ago

@peterzhuamazon What is the process to provide highlight in Release Notes for OpenSearch Core?

Hi @shwetathareja you can work with @jhmcintyre on that.

Thanks.

hdhalter commented 4 months ago

Documentation draft PRs are up and in tech review for all component changes

Documentation status is green for the entrance criteria.

peterzhuamazon commented 4 months ago

RC 3 OpenSearch 9978 / OpenSearch Dashboards 7735 is ready for your test.

OpenSearch - Build 9978 OpenSearch Dashboards - Build 7735

Use the following Docker-Compose to setup a cluster

docker-compose.yml


version: '3'
services:
opensearch-node1:
  image: opensearchstaging/opensearch:2.15.0.9978
  container_name: opensearch-node1
  environment:
    - cluster.name=opensearch-cluster
    - node.name=opensearch-node1
    - discovery.seed_hosts=opensearch-node1,opensearch-node2
    - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
    - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping
    - OPENSEARCH_INITIAL_ADMIN_PASSWORD=${OPENSEARCH_INITIAL_ADMIN_PASSWORD}
  ulimits:
    memlock:
      soft: -1
      hard: -1
    nofile:
      soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems
      hard: 65536
  volumes:
    - opensearch-data1:/usr/share/opensearch/data
  ports:
    - 9200:9200
    - 9600:9600 # required for Performance Analyzer
  networks:
    - opensearch-net
opensearch-node2:
  image: opensearchstaging/opensearch:2.15.0.9978
  container_name: opensearch-node2
  environment:
    - cluster.name=opensearch-cluster
    - node.name=opensearch-node2
    - discovery.seed_hosts=opensearch-node1,opensearch-node2
    - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
    - bootstrap.memory_lock=true
    - OPENSEARCH_INITIAL_ADMIN_PASSWORD=${OPENSEARCH_INITIAL_ADMIN_PASSWORD}
  ulimits:
    memlock:
      soft: -1
      hard: -1
    nofile:
      soft: 65536
      hard: 65536
  volumes:
    - opensearch-data2:/usr/share/opensearch/data
  networks:
    - opensearch-net
opensearch-dashboards:
  image: opensearchstaging/opensearch-dashboards:2.15.0.7735
  container_name: opensearch-dashboards
  ports:
    - 5601:5601
  expose:
    - "5601"
  environment:
    OPENSEARCH_HOSTS: '["https://opensearch-node1:9200","https://opensearch-node2:9200"]'
  networks:
    - opensearch-net
volumes:
opensearch-data1:
opensearch-data2:

networks:
opensearch-net:

Download the above docker-compose.yml on your machine.
Get latest image versions docker-compose pull.
Start the cluster docker-compose up.

OpenSearch docker 2.15.0.9978
- Start without security
  - Docker command docker pull opensearchstaging/opensearch:2.15.0.9978 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.15.0.9978
- Connect command curl http://localhost:9200/
- Start with security
- Docker command docker pull opensearchstaging/opensearch:2.15.0.9978 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "OPENSEARCH_INITIAL_ADMIN_PASSWORD=<custom-admin-password>" opensearchstaging/opensearch:2.15.0.9978
- Connect command curl --insecure https://admin:<custom-admin-password>@localhost:9200/
OpenSearch-Dashboards docker 2.15.0.7735
- Start without security
- Docker command docker pull opensearchstaging/opensearch-dashboards:2.15.0.7735 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:2.15.0.7735
- URL http://localhost:5601/
- Start with security
- Docker command docker pull opensearchstaging/opensearch-dashboards:2.15.0.7735 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:2.15.0.7735
- URL http://localhost:5601/
Use TARs to deploy OpenSearch Manually
- OpenSearch - Build 9978 (Note: Windows version does not have performance analyzer plugin)
- arm64 [manifest] [tar] [rpm][deb]
- x64 [manifest] [tar] [rpm] [deb] [windows]
- OpenSearch Dashboards - Build 7735
- arm64 [manifest] [tar][rpm][deb]
- x64 [manifest] [tar][rpm] [deb] [windows]

Check how to install opensearch and dashboards on different platforms

peterzhuamazon commented 4 months ago

RC4 Changes

06/17 https://github.com/opensearch-project/opensearch-build/pull/4785

peterzhuamazon commented 4 months ago

RC 4 OpenSearch 9986 / OpenSearch Dashboards 7742 is ready for your test.

OpenSearch - Build 9986 OpenSearch Dashboards - Build 7742

Use the following Docker-Compose to setup a cluster

docker-compose.yml


version: '3'
services:
opensearch-node1:
  image: opensearchstaging/opensearch:2.15.0.9986
  container_name: opensearch-node1
  environment:
    - cluster.name=opensearch-cluster
    - node.name=opensearch-node1
    - discovery.seed_hosts=opensearch-node1,opensearch-node2
    - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
    - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping
    - OPENSEARCH_INITIAL_ADMIN_PASSWORD=${OPENSEARCH_INITIAL_ADMIN_PASSWORD}
  ulimits:
    memlock:
      soft: -1
      hard: -1
    nofile:
      soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems
      hard: 65536
  volumes:
    - opensearch-data1:/usr/share/opensearch/data
  ports:
    - 9200:9200
    - 9600:9600 # required for Performance Analyzer
  networks:
    - opensearch-net
opensearch-node2:
  image: opensearchstaging/opensearch:2.15.0.9986
  container_name: opensearch-node2
  environment:
    - cluster.name=opensearch-cluster
    - node.name=opensearch-node2
    - discovery.seed_hosts=opensearch-node1,opensearch-node2
    - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
    - bootstrap.memory_lock=true
    - OPENSEARCH_INITIAL_ADMIN_PASSWORD=${OPENSEARCH_INITIAL_ADMIN_PASSWORD}
  ulimits:
    memlock:
      soft: -1
      hard: -1
    nofile:
      soft: 65536
      hard: 65536
  volumes:
    - opensearch-data2:/usr/share/opensearch/data
  networks:
    - opensearch-net
opensearch-dashboards:
  image: opensearchstaging/opensearch-dashboards:2.15.0.7742
  container_name: opensearch-dashboards
  ports:
    - 5601:5601
  expose:
    - "5601"
  environment:
    OPENSEARCH_HOSTS: '["https://opensearch-node1:9200","https://opensearch-node2:9200"]'
  networks:
    - opensearch-net
volumes:
opensearch-data1:
opensearch-data2:

networks:
opensearch-net:

Download the above docker-compose.yml on your machine.
Get latest image versions docker-compose pull.
Start the cluster docker-compose up.

OpenSearch docker 2.15.0.9986
- Start without security
  - Docker command docker pull opensearchstaging/opensearch:2.15.0.9986 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.15.0.9986
- Connect command curl http://localhost:9200/
- Start with security
- Docker command docker pull opensearchstaging/opensearch:2.15.0.9986 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "OPENSEARCH_INITIAL_ADMIN_PASSWORD=<custom-admin-password>" opensearchstaging/opensearch:2.15.0.9986
- Connect command curl --insecure https://admin:<custom-admin-password>@localhost:9200/
OpenSearch-Dashboards docker 2.15.0.7742
- Start without security
- Docker command docker pull opensearchstaging/opensearch-dashboards:2.15.0.7742 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:2.15.0.7742
- URL http://localhost:5601/
- Start with security
- Docker command docker pull opensearchstaging/opensearch-dashboards:2.15.0.7742 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:2.15.0.7742
- URL http://localhost:5601/
Use TARs to deploy OpenSearch Manually
- OpenSearch - Build 9986 (Note: Windows version does not have performance analyzer plugin)
- arm64 [manifest] [tar] [rpm][deb]
- x64 [manifest] [tar] [rpm] [deb] [windows]
- OpenSearch Dashboards - Build 7742
- arm64 [manifest] [tar][rpm][deb]
- x64 [manifest] [tar][rpm] [deb] [windows]

Check how to install opensearch and dashboards on different platforms

peterzhuamazon commented 4 months ago

RC5 Changes

06/18 https://github.com/opensearch-project/opensearch-build/pull/4790

peterzhuamazon commented 4 months ago

RC 5 OpenSearch 9992 / OpenSearch Dashboards 7749 is ready for your test.

OpenSearch - Build 9992 OpenSearch Dashboards - Build 7749

Use the following Docker-Compose to setup a cluster

docker-compose.yml


version: '3'
services:
opensearch-node1:
  image: opensearchstaging/opensearch:2.15.0.9992
  container_name: opensearch-node1
  environment:
    - cluster.name=opensearch-cluster
    - node.name=opensearch-node1
    - discovery.seed_hosts=opensearch-node1,opensearch-node2
    - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
    - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping
    - OPENSEARCH_INITIAL_ADMIN_PASSWORD=${OPENSEARCH_INITIAL_ADMIN_PASSWORD}
  ulimits:
    memlock:
      soft: -1
      hard: -1
    nofile:
      soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems
      hard: 65536
  volumes:
    - opensearch-data1:/usr/share/opensearch/data
  ports:
    - 9200:9200
    - 9600:9600 # required for Performance Analyzer
  networks:
    - opensearch-net
opensearch-node2:
  image: opensearchstaging/opensearch:2.15.0.9992
  container_name: opensearch-node2
  environment:
    - cluster.name=opensearch-cluster
    - node.name=opensearch-node2
    - discovery.seed_hosts=opensearch-node1,opensearch-node2
    - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
    - bootstrap.memory_lock=true
    - OPENSEARCH_INITIAL_ADMIN_PASSWORD=${OPENSEARCH_INITIAL_ADMIN_PASSWORD}
  ulimits:
    memlock:
      soft: -1
      hard: -1
    nofile:
      soft: 65536
      hard: 65536
  volumes:
    - opensearch-data2:/usr/share/opensearch/data
  networks:
    - opensearch-net
opensearch-dashboards:
  image: opensearchstaging/opensearch-dashboards:2.15.0.7749
  container_name: opensearch-dashboards
  ports:
    - 5601:5601
  expose:
    - "5601"
  environment:
    OPENSEARCH_HOSTS: '["https://opensearch-node1:9200","https://opensearch-node2:9200"]'
  networks:
    - opensearch-net
volumes:
opensearch-data1:
opensearch-data2:

networks:
opensearch-net:

Download the above docker-compose.yml on your machine.
Get latest image versions docker-compose pull.
Start the cluster docker-compose up.

OpenSearch docker 2.15.0.9992
- Start without security
  - Docker command docker pull opensearchstaging/opensearch:2.15.0.9992 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.15.0.9992
- Connect command curl http://localhost:9200/
- Start with security
- Docker command docker pull opensearchstaging/opensearch:2.15.0.9992 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "OPENSEARCH_INITIAL_ADMIN_PASSWORD=<custom-admin-password>" opensearchstaging/opensearch:2.15.0.9992
- Connect command curl --insecure https://admin:<custom-admin-password>@localhost:9200/
OpenSearch-Dashboards docker 2.15.0.7749
- Start without security
- Docker command docker pull opensearchstaging/opensearch-dashboards:2.15.0.7749 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:2.15.0.7749
- URL http://localhost:5601/
- Start with security
- Docker command docker pull opensearchstaging/opensearch-dashboards:2.15.0.7749 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:2.15.0.7749
- URL http://localhost:5601/
Use TARs to deploy OpenSearch Manually
- OpenSearch - Build 9992 (Note: Windows version does not have performance analyzer plugin)
- arm64 [manifest] [tar] [rpm][deb]
- x64 [manifest] [tar] [rpm] [deb] [windows]
- OpenSearch Dashboards - Build 7749
- arm64 [manifest] [tar][rpm][deb]
- x64 [manifest] [tar][rpm] [deb] [windows]

Check how to install opensearch and dashboards on different platforms

peterzhuamazon commented 4 months ago

OpenSearch Performance Graphs

We are seeing no significant improvement or regression in Indexing throughput or overall search latency compared to 2.14.0.

NYC Taxis nyc_taxis_x64_compar_2024-06-20T17_59_15

HTTP LOGS

peterzhuamazon commented 4 months ago

RC5 integration test results

Note:
- ccr will not run on deb/rpm as it needs multi cluster due to build#4610
- ml/flow/neural test should ignore arm64 tar due to ml#2563
- skills test should ignore arm64 tar due to ml#2578

OpenSearch

Dashboards

shwetathareja commented 4 months ago

@peterzhuamazon do we have plans to cut RC6? This one line change PR needs to be merged - https://github.com/opensearch-project/OpenSearch/pull/14488

kolchfa-aws commented 4 months ago

All OpenSearch 2.15 documentation PRs are merged and we're ready for the release.

peterzhuamazon commented 4 months ago

We are a GO :white_check_mark: to launch the 2.15.0 release. Thanks everyone who contribute and help support this release.

We have the 2.15.0 Launch Meeting happening at 2:00PM PST 06/25 Today! https://opensearch.org/events/2024-0625-2-15-release-meetings/

You can join the meeting with these info:

Join Meeting

Click to join the meeting: https://chime.aws/7306222022

Meeting ID: 7306222022

A headset is recommended or you may use your computer's microphone and speakers.

Call in using your phone:

    United States Toll-Free (1): +1 855-552-4463
    United States (1): +1 206-462-5569
    International: https://chime.aws/dialinnumbers/

Dial-in attendees must enter *7 to mute or unmute themselves.

Thanks.

peterzhuamazon commented 4 months ago

Sha verifications:

% gpg --verify opensearch-2.15.0-linux-x64.tar.gz.sig
gpg: Signature made Tue 25 Jun 2024 09:42:26 PM UTC using RSA key ID 542C03B4
gpg: Good signature from "OpenSearch project <opensearch@amazon.com>"
gpg: WARNING: This key is not certified with a trusted signature!
gpg:          There is no indication that the signature belongs to the owner.
Primary key fingerprint: C5B7 4989 65EF D1C2 924B  A9D5 39D3 1987 9310 D3FC
     Subkey fingerprint: 2187 3199 B103 0FCD 49DA  83F8 C2EE 2AF6 542C 03B4

peterzhuamazon commented 4 months ago

Native plugins:

 % ./opensearch-plugin install repository-s3
-> Installing repository-s3
-> Downloading repository-s3 from opensearch
[=================================================] 100%
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@     WARNING: plugin requires additional permissions     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
* java.io.FilePermission config#plus read
* java.lang.RuntimePermission accessDeclaredMembers
* java.lang.RuntimePermission getClassLoader
* java.lang.RuntimePermission setContextClassLoader
* java.lang.reflect.ReflectPermission suppressAccessChecks
* java.net.NetPermission setDefaultAuthenticator
* java.net.SocketPermission * connect,resolve
* java.util.PropertyPermission aws.configFile read,write
* java.util.PropertyPermission aws.sharedCredentialsFile read,write
* java.util.PropertyPermission opensearch.allow_insecure_settings read,write
* java.util.PropertyPermission opensearch.path.conf read,write
See http://docs.oracle.com/javase/8/docs/technotes/guides/security/permissions.html
for descriptions of what these permissions allow and the associated risks.

Continue with installation? [y/N]y
-> Installed repository-s3 with folder name repository-s3

peterzhuamazon commented 4 months ago

Maven released now: https://repo1.maven.org/maven2/org/opensearch/opensearch/2.15.0/

peterzhuamazon commented 4 months ago

2.15.0 Release Now:

peterzhuamazon commented 4 months ago

Close this as 2.15.0 Release Retro is completed now.

Thanks.

max-allan-cgr commented 4 months ago

@peterzhuamazon I am not seeing a 2.15.0 release in the GitHub releases page yet. https://github.com/opensearch-project/OpenSearch-Dashboards/releases?q=&expanded=true As of right now, 2.14 is showing as "Latest". Is there some automation that has failed or a manual step missed? Or is it normal to take so long for a release to complete?

opensearch-project / opensearch-build

[RELEASE] Release version 2.15.0 #4681

Release OpenSearch and OpenSearch Dashboards 2.15.0

Entrance Criteria

OpenSearch 2.15.0 exit criteria status:

OpenSearch-Dashboards 2.15.0 exit criteria status:

Preparation

Campaigns

Release Branch and Version Increment - Ends 2024/06/10 4PM PST

Feature Freeze - Ends 2024/06/11 4PM PST

Code Complete - Ends 2024/06/11 4PM PST

Release Candidate Creation and Testing - Starts 2024/06/11 after 4PM

Performance testing validation - Starts 2024/06/11

Pre Release

Release - 2024/06/25

Release Checklist.

Post Release

Components

OpenSearch

OpenSearch Dashboards

Issues / PRs:

Links

Core Components CommitID(after 2024-05-14) & Release Notes info

Core Components CommitID(after 2024-05-14) & Release Notes info

RC 1 OpenSearch 9964 / OpenSearch Dashboards 7729 is ready for your test.

RC2 Changes:

RC 2 OpenSearch 9970 / OpenSearch Dashboards 7731 is ready for your test.

RC3 Changes

RC 3 OpenSearch 9978 / OpenSearch Dashboards 7735 is ready for your test.

RC4 Changes

RC 4 OpenSearch 9986 / OpenSearch Dashboards 7742 is ready for your test.

RC5 Changes

RC 5 OpenSearch 9992 / OpenSearch Dashboards 7749 is ready for your test.

OpenSearch Performance Graphs

RC5 integration test results

OpenSearch

Dashboards