Closed github-actions[bot] closed 1 year ago
We will see once release build occurs but seeing some issues were node 18 + localhost and cypress latest wasnβt playing nicely.
therefore some plugins (if not all) might need https://github.com/opensearch-project/opensearch-build/blob/main/manifests/2.8.0/opensearch-dashboards-2.8.0-test.yml#L13 to include server.host: 0.0.0.0 and an environment variable for baseUrl: 'http://0.0.0.0:5601/ but I recommended holding off any action until we get a test run.
More info:
https://github.com/cypress-io/github-action/issues/811
Verify 2.8 Branches:
$ for i in `yq -r '.components.[].repository' manifests/2.8.0/opensearch-2.8.0.yml`; do echo $i; git ls-remote --heads $i 2.8; done
$ for i in `yq -r '.components.[].repository' manifests/2.8.0/opensearch-dashboards-2.8.0.yml`; do echo $i; git ls-remote --heads $i 2.8; done
Missing:
https://github.com/opensearch-project/cross-cluster-replication.git
https://github.com/opensearch-project/asynchronous-search.git
https://github.com/opensearch-project/performance-analyzer.git
https://github.com/opensearch-project/OpenSearch-Dashboards.git
All cut now.
https://github.com/opensearch-project/anomaly-detection-dashboards-plugin also haven't cut the 2.8 branch yet.
Repo | Branch | CommitID | Commit Date | Release Notes |
---|---|---|---|---|
OpenSearch | 9e5231c5c3937befe54e0106a5477bd3d08f8ef3 | 9e5231c | 2023-05-31 | True |
common-utils | f435dbca179c459b74df2bd19cb4b46f0e8cd8c5 | True | ||
job-scheduler | c6cd7b369651ea45930449d01dc2c65b4f5f557e | True | ||
k-NN | f11f1f1d4ad0de76b05517b57bcc87e0a6788031 | True | ||
geospatial | 44ff69db3e98170117b4237bffeb35e1580189ec | True | ||
security | 60f392d6e0dccb0aadef23a235291ef0f10f4f36 | True | ||
cross-cluster-replication | 261d7abb361958e37a378dd387543f49c5c98b51 | True | ||
ml-commons | b152ad3ecfaf4b684be21ba1c09e5fec64572b42 | b152ad3 | 2023-05-31 | True |
neural-search | 3e6aa00d667ddc8490cc8dcbb31c61d962188d83 | True | ||
notifications-core | 6613fce3e68048ca96b1b79b2e59a32d4268a921 | True | ||
notifications | 6613fce3e68048ca96b1b79b2e59a32d4268a921 | True | ||
opensearch-observability | 0ea64d81430af9a75c3e2519f84e6d10bb91c515 | True | ||
opensearch-reports | d7ff8cd6b6c97012c53de718835a2fd4985479bf | True | ||
sql | 8ea39ef9edc572cf36a6ce2d51f83f789e13a22b | True | ||
asynchronous-search | b255fa2d7d682f75edb161c4857d90148c3d29d3 | True | ||
anomaly-detection | 297ca1e2e427f3d710a6887d6397451ae2ec695e | True | ||
alerting | 3c2d5a6351fc96568ca60b7609685fdc9276f5a0 | True | ||
security-analytics | d9cd0a0698ad51c0074a69689010407dc97a3fce | True | ||
index-management | 5c420129ee8e6f8921a2248590f79e0e35b85730 | True | ||
performance-analyzer | 89eeaa4ff83e6560fc8c136c0460233b5b0b4330 | 89eeaa4 | 2023-05-31 | True |
Repo | Branch | CommitID | Commit Date | Release Notes |
---|---|---|---|---|
OpenSearch-Dashboards | 23b174303ef8d8b2f552cd573db10ef6ab2ae3f5 | 23b1743 | 2023-05-31 | False |
functionalTestDashboards | 35b0c7e88c21210f2402ce39f992b4a3ba0a514f | False | ||
observabilityDashboards | 4f8484a7f4cd436db1c5f0f82ee20f817b5433dd | True | ||
reportsDashboards | 75205dba4bc1668f6706e40efbfcd7cd875676ae | True | ||
ganttChartDashboards | c1f2dbf660d62a6b742c89927a3e8af6ad5f1eda | True | ||
queryWorkbenchDashboards | a3c8b8791ca53165f7d798cf3c1835a487369c48 | True | ||
customImportMapDashboards | 0d976e7a8da11282a600e5e9780f464dab70475c | True | ||
anomalyDetectionDashboards | 56ee83042d77b61ee600f6df7675445c10e3c964 | 56ee830 | 2023-05-31 | True |
mlCommonsDashboards | 95ce3543148b6cb5d1be9d70d6b787539feda6be | True | ||
indexManagementDashboards | c9294e604884eb742a5b891562a8add212d86d70 | True | ||
notificationsDashboards | d369cfb77cf31a5007f81192717140ee7717ce6f | True | ||
alertingDashboards | 9af360d7d68443068eb1f5a4a834504b51487b9b | True | ||
securityAnalyticsDashboards | 47b2a21e9c25397a905200225e7ef6f5caadb827 | 47b2a21 | 2023-05-31 | True |
securityDashboards | ae083f97337dbe865d10e7d11897d2ab5c2f8afc | ae083f9 | 2023-05-31 | True |
searchRelevanceDashboards | 88bba5faed5f8a6e49b68cd9f403121e8fd87bb6 | True |
OpenSearch - Build 7935 OpenSearch Dashboards - Build 6182
Use Docker-Compose to setup a cluster
docker-compose pull
docker-compose up
docker pull opensearchstaging/opensearch:2.8.0.7935 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.8.0.7935
curl https://localhost:9200/
docker pull opensearchstaging/opensearch:2.8.0.7935 && docker run -it -p 9200:9200 -e "discovery.type=single-node" opensearchstaging/opensearch:2.8.0.7935
curl --insecure https://admin:admin@localhost:9200/
OpenSearch-Dashboards docker 2.8.0.6182
docker pull opensearchstaging/opensearch-dashboards:2.8.0.6182 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:2.8.0.6182
https://localhost:5601/
docker pull opensearchstaging/opensearch-dashboards:2.8.0.6182 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:2.8.0.6182
https://localhost:5601/
Use TARs to deploy OpenSearch Manually
Check how to install opensearch and dashboards on different platforms
IntegTests:
OS 7935:
Tar:
DEB:
RPM:
OSD 6182:
Local test run on linux with security (with my node modules cached so some errors aren't accurate)
Product/ Version | Architecture | Description | Instance Type | Workload | Index latency (p50) | Index latencyp90 | Index latencyp99 | Index latencyp100 | Index throughputp0 | Index throughputp50 | Index throughputp100 | Ops Count | Op Error Count | Error Rate | Query latencyp50 | Query latencyp90 | Query latencyp99 | Query latencyp100 | Query throughputp0 | Query throughputp50 | Query throughputp100 | Ops Count | Op Error Count | Error Rate | CPUp50 | CPUp90 | CPUp99 | CPUp100 | Memoryp50 | Memoryp90 | Memoryp99 | Memoryp100 | Old | Young |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2.8.0 | x64 | with_security | m5.xlarge | nyc_taxis / 2 warmupIterations / 3 testIterations | 2,258.1 | 3,007.8 | 5,871.9 | 8,746.7 | 32,246 | 33,971.4 | 38,121.1 | 46,890 | 0 | 0 | 276.1 | 281.6 | 292 | 313.6 | 1.726 | 1.74 | 1.753 | 1,510 | 0 | 0 | 97 | 100 | 100 | 100 | 53 | 66 | 78.65 | 93 | 0 | 1,238,141 |
2.8.0 | x64 | without_security | m5.xlarge | nyc_taxis / 2 warmupIterations / 3 testIterations | 2,160.6 | 2,881.2 | 5,637.9 | 9,982.8 | 33,564.6 | 35,734.3 | 40,595.5 | 46,742 | 0 | 0 | 285.5 | 292.7 | 302.4 | 309.7 | 1.727 | 1.741 | 1.756 | 1,510 | 0 | 0 | 97 | 99 | 100 | 100 | 50.75 | 65 | 91.38 | 97 | 0 | 1,053,492 |
Comparison | Β | Β | Β | Β | 4.32% | 4.21% | 3.99% | -14.13% | 4.09% | 5.19% | 6.49% | Β | Β | Β | -3.40% | -3.94% | -3.56% | 1.24% | 0.06% | 0.06% | 0.17% | Β | Β | Β | Β | Β | Β | Β | Β | Β | Β | Β | Β | Β |
Product/ Version | Architecture | Description | Instance Type | Workload | Index latency (p50) | Index latencyp90 | Index latencyp99 | Index latencyp100 | Index throughputp0 | Index throughputp50 | Index throughputp100 | Ops Count | Op Error Count | Error Rate | Query latencyp50 | Query latencyp90 | Query latencyp99 | Query latencyp100 | Query throughputp0 | Query throughputp50 | Query throughputp100 | Ops Count | Op Error Count | Error Rate | CPUp50 | CPUp90 | CPUp99 | CPUp100 | Memoryp50 | Memoryp90 | Memoryp99 | Memoryp100 | Old | Young |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2.8.0 | arm64 | with_security | m6g.xlarge | nyc_taxis / 2 warmupIterations / 3 testIterations | 1,710.3 | 2,275.4 | 4,314.7 | 6,987.6 | 42,197.8 | 44,490.6 | 48,768 | 46,102 | 0 | 0 | 409.9 | 422.1 | 430.2 | 435.3 | 1.725 | 1.739 | 1.753 | 1,510 | 0 | 0 | 96 | 98 | 100 | 100 | 53 | 67 | 88.04 | 93 | 0 | 996,946 |
2.8.0 | arm64 | without_security | m6g.xlarge | nyc_taxis / 2 warmupIterations / 3 testIterations | 1,564.4 | 2,090.7 | 4,112.6 | 7,385.6 | 46,324.5 | 48,112.4 | 52,931.5 | 45,820 | 0 | 0 | 327.8 | 337.1 | 342.5 | 350 | 1.731 | 1.743 | 1.756 | 1,510 | 0 | 0 | 96 | 98 | 100 | 100 | 48 | 64 | 92.04 | 95 | 0 | 848,496 |
Product/ Version | Architecture | Description | Instance Type | Workload | Index latency (p50) | Index latencyp90 | Index latencyp99 | Index latencyp100 | Index throughputp0 | Index throughputp50 | Index throughputp100 | Ops Count | Op Error Count | Error Rate | Query latencyp50 | Query latencyp90 | Query latencyp99 | Query latencyp100 | Query throughputp0 | Query throughputp50 | Query throughputp100 | Ops Count | Op Error Count | Error Rate | CPUp50 | CPUp90 | CPUp99 | CPUp100 | Memoryp50 | Memoryp90 | Memoryp99 | Memoryp100 | Old | Young |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2.7.0 | x64 | with_security | m5.xlarge | nyc_taxis / 2 warmupIterations / 3 testIterations | 2,318.4 | 3,065.2 | 5,775.2 | 9,499 | 31,751 | 33,313.5 | 37,468.2 | 46,931 | 0 | 0 | 296.4 | 310.9 | 326.3 | 337 | 1.724 | 1.739 | 1.753 | 1510 | 0 | 0 | 97 | 99 | 100 | 100 | 53 | 66 | 87.14 | 94 | 0 | 1,220,516 |
2.8.0 | x64 | with_security | m5.xlarge | nyc_taxis / 2 warmupIterations / 3 testIterations | 2,258.1 | 3,007.8 | 5,871.9 | 8,746.7 | 32,246 | 33,971.4 | 38,121.1 | 46,890 | 0 | 0 | 276.1 | 281.6 | 292 | 313.6 | 1.726 | 1.74 | 1.753 | 1,510 | 0 | 0 | 97 | 100 | 100 | 100 | 53 | 66 | 78.65 | 93 | 0 | 1,238,141 |
Comparison | Β | Β | Β | Β | 2.60% | 1.87% | -1.67% | 7.92% | 1.56% | 1.97% | 1.74% | Β | Β | Β | 6.85% | 9.42% | 10.51% | 6.94% | 0.12% | 0.06% | 0.00% | Β | Β | Β | Β | Β | Β | Β | Β | Β | Β | Β | Β | Β |
Product/ Version | Architecture | Description | Instance Type | Workload | Index latency (p50) | Index latencyp90 | Index latencyp99 | Index latencyp100 | Index throughputp0 | Index throughputp50 | Index throughputp100 | Ops Count | Op Error Count | Error Rate | Query latencyp50 | Query latencyp90 | Query latencyp99 | Query latencyp100 | Query throughputp0 | Query throughputp50 | Query throughputp100 | Ops Count | Op Error Count | Error Rate | CPUp50 | CPUp90 | CPUp99 | CPUp100 | Memoryp50 | Memoryp90 | Memoryp99 | Memoryp100 | Old | Young |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2.7.0 | x64 | without_security | m5.xlarge | nyc_taxis / 2 warmupIterations / 3 testIterations | 2,170.8 | 2,916.6 | 5,512.7 | 9,747.3 | 33,671.9 | 35,557 | 39,831.6 | 46,783 | 0 | 0 | 277.3 | 282.9 | 290 | 300.2 | 1.716 | 1.734 | 1.752 | 1510 | 0 | 0 | 97 | 100 | 100 | 100 | 51 | 63 | 88 | 94 | 0 | 1,037,614 |
2.8.0 | x64 | without_security | m5.xlarge | nyc_taxis / 2 warmupIterations / 3 testIterations | 2,160.6 | 2,881.2 | 5,637.9 | 9,982.8 | 33,564.6 | 35,734.3 | 40,595.5 | 46,742 | 0 | 0 | 285.5 | 292.7 | 302.4 | 309.7 | 1.727 | 1.741 | 1.756 | 1,510 | 0 | 0 | 97 | 99 | 100 | 100 | 50.75 | 65 | 91.38 | 97 | 0 | 1,053,492 |
Comparison | Β | Β | Β | Β | 0.47% | 1.21% | -2.27% | -2.42% | -0.32% | 0.50% | 1.92% | Β | Β | Β | -2.96% | -3.46% | -4.28% | -3.16% | 0.64% | 0.40% | 0.23% | Β | Β | Β | Β | Β | Β | Β | Β | Β | Β | Β | Β | Β |
Product/ Version | Architecture | Description | Instance Type | Workload | Index latency (p50) | Index latencyp90 | Index latencyp99 | Index latencyp100 | Index throughputp0 | Index throughputp50 | Index throughputp100 | Ops Count | Op Error Count | Error Rate | Query latencyp50 | Query latencyp90 | Query latencyp99 | Query latencyp100 | Query throughputp0 | Query throughputp50 | Query throughputp100 | Ops Count | Op Error Count | Error Rate | CPUp50 | CPUp90 | CPUp99 | CPUp100 | Memoryp50 | Memoryp90 | Memoryp99 | Memoryp100 | Old | Young |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2.7.0 | arm64 | with_security | m6g.xlarge | nyc_taxis / 2 warmupIterations / 3 testIterations | 1,741.8 | 2,336.1 | 4,227.1 | 6,758.6 | 41,226.7 | 42,941.1 | 46,643.1 | 46,281 | 0 | 0 | 317.8 | 331 | 334.3 | 407.8 | 1.718 | 1.735 | 1.749 | 1510 | 0 | 0 | 95.667 | 98.8 | 100 | 100 | 52 | 66 | 76.72 | 88 | 0 | 968,100 |
2.8.0 | arm64 | with_security | m6g.xlarge | nyc_taxis / 2 warmupIterations / 3 testIterations | 1,710.3 | 2,275.4 | 4,314.7 | 6,987.6 | 42,197.8 | 44,490.6 | 48,768 | 46,102 | 0 | 0 | 409.9 | 422.1 | 430.2 | 435.3 | 1.725 | 1.739 | 1.753 | 1,510 | 0 | 0 | 96 | 98 | 100 | 100 | 53 | 67 | 88.04 | 93 | 0 | 996,946 |
Comparison | Β | Β | Β | Β | 1.81% | 2.60% | -2.07% | -3.39% | 2.36% | 3.61% | 4.56% | Β | Β | Β | -28.98% | -27.52% | -28.69% | -6.74% | 0.41% | 0.23% | 0.23% | Β | Β | Β | Β | Β | Β | Β | Β | Β | Β | Β | Β | Β |
Product/ Version | Architecture | Description | Instance Type | Workload | Index latency (p50) | Index latencyp90 | Index latencyp99 | Index latencyp100 | Index throughputp0 | Index throughputp50 | Index throughputp100 | Ops Count | Op Error Count | Error Rate | Query latencyp50 | Query latencyp90 | Query latencyp99 | Query latencyp100 | Query throughputp0 | Query throughputp50 | Query throughputp100 | Ops Count | Op Error Count | Error Rate | CPUp50 | CPUp90 | CPUp99 | CPUp100 | Memoryp50 | Memoryp90 | Memoryp99 | Memoryp100 | Old | Young |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2.7.0 | arm64 | without_security | m6g.xlarge | nyc_taxis / 2 warmupIterations / 3 testIterations | 1,649.4 | 2,232.5 | 4,155.6 | 7,537 | 43,950.6 | 45,584.2 | 49,754.1 | 46,048 | 0 | 0 | 331.7 | 372.7 | 377.9 | 383.7 | 1.727 | 1.741 | 1.756 | 1510 | 0 | 0 | 96 | 98 | 100 | 100 | 49 | 64 | 85.6 | 95 | 0 | 816,604 |
2.8.0 | arm64 | without_security | m6g.xlarge | nyc_taxis / 2 warmupIterations / 3 testIterations | 1,564.4 | 2,090.7 | 4,112.6 | 7,385.6 | 46,324.5 | 48,112.4 | 52,931.5 | 45,820 | 0 | 0 | 327.8 | 337.1 | 342.5 | 350 | 1.731 | 1.743 | 1.756 | 1,510 | 0 | 0 | 96 | 98 | 100 | 100 | 48 | 64 | 92.04 | 95 | 0 | 848,496 |
Comparison | Β | Β | Β | Β | 5.15% | 6.35% | 1.03% | 2.01% | 5.40% | 5.55% | 6.39% | Β | Β | Β | 1.18% | 9.55% | 9.37% | 8.78% | 0.23% | 0.11% | 0.00% | Β | Β | Β | Β | Β | Β | Β | Β | Β | Β | Β | Β | Β |
see reindex may have some issue with the docker image , https://github.com/opensearch-project/OpenSearch/issues/7878
All integTests are either passing or have plugin owner sign off manually.a
Native plugin installation working fine.
dev-dsk-sngri-1c-8de54c16 % bin/opensearch-plugin install discovery-ec2
-> Installing discovery-ec2
-> Downloading discovery-ec2 from opensearch
[=================================================] 100%
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@ WARNING: plugin requires additional permissions @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
* java.lang.RuntimePermission accessDeclaredMembers
* java.lang.RuntimePermission getClassLoader
* java.lang.reflect.ReflectPermission suppressAccessChecks
* java.net.SocketPermission * connect,resolve
See http://docs.oracle.com/javase/8/docs/technotes/guides/security/permissions.html
for descriptions of what these permissions allow and the associated risks.
Continue with installation? [y/N]y
-> Installed discovery-ec2 with folder name discovery-ec2
dev-dsk-sngri-1c-8de54c16 % bin/opensearch-plugin install repository-s3
-> Installing repository-s3
-> Downloading repository-s3 from opensearch
[=================================================] 100%
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@ WARNING: plugin requires additional permissions @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
* java.lang.RuntimePermission accessDeclaredMembers
* java.lang.RuntimePermission getClassLoader
* java.lang.reflect.ReflectPermission suppressAccessChecks
* java.net.NetPermission setDefaultAuthenticator
* java.net.SocketPermission * connect,resolve
* java.util.PropertyPermission opensearch.allow_insecure_settings read,write
See http://docs.oracle.com/javase/8/docs/technotes/guides/security/permissions.html
for descriptions of what these permissions allow and the associated risks.
Continue with installation? [y/N]y
-> Installed repository-s3 with folder name repository-s3
We have officially released 2.8.0 version on 2023/06/06:
Thanks.
Since 2.8.0 is released to the public and the retro is completed. We will close this issue now.
Thanks.
Release OpenSearch and OpenSearch Dashboards 2.8.0
I noticed that a manifest was automatically created in manifests/2.8.0. Please follow the following checklist to make a release.
How to use this issue
## This Release Issue This issue captures the state of the OpenSearch release, its assignee is responsible for driving the release. Please contact them or @mention them on this issue for help. There are linked issues on components of the release where individual components can be tracked. More details are included in the Maintainers [Release owner](https://github.com/opensearch-project/opensearch-build/blob/main/MAINTAINERS.md#release-owner) section. ## Release Steps There are several steps to the release process, these steps are completed as the whole release and components that are behind present risk to the release. The release owner completes the tasks in this ticket, whereas component owners resolve tasks on their ticket in their repositories. Steps have completion dates for coordinating efforts between the components of a release; components can start as soon as they are ready far in advance of a future release. ### Component List To aid in understanding the state of the release there is a table with status indicating each component state. This is updated based on the status of the component issues.
Preparation
__REPLACE_RELEASE-__
placeholders have actual dates.Campaigns
See comments
Release Branch - Ends 2023/05/25
2.8
early.2.8
branch for the release.Feature Freeze - Ends 2023/05/30
Code Complete - Ends 2023/05/30
Release testing - Starts 2023/05/31 - Ends 2023/06/02
Performance testing validation - Starts 2023/06/01 - Ends 2023/06/03
Release - 2023/06/06
v2.8.0
in all projects have been resolved.Post Release
2.8.0
release.2.8.0
release.Components
Replace with links to all component tracking issues.
Legend
| Symbol | Meaning | | -------- | ---------- | | :green_circle: | On track with overall release | | :yellow_circle: | Missed last milestone | | :red_circle: | Missed multiple milestones |