[RELEASE] Release version 2.15.0

[github-actions]

Release OpenSearch and OpenSearch Dashboards 2.15.0

I noticed that a manifest was automatically created in manifests/2.15.0. Please follow the following checklist to make a release.

How to use this issue

This Release Issue

This issue captures the state of the OpenSearch release, its assignee (Release Manager) is responsible for driving the release. Please contact them or @mention them on this issue for help. There are linked issues on components of the release where individual components can be tracked. For more information check the the Release Process OpenSearch Guide.

Please refer to the following link for the release version dates: Release Schedule and Maintenance Policy.

Entrance Criteria

Criteria	Status	Description	Comments
Documentation draft PRs are up and in tech review for all component changes	🟢
Sanity testing is done for all components	🟢
Code coverage has not decreased (all new code has tests)	🟢
Release notes are ready and available for all components	🟢
Roadmap is up-to-date (information is available to create release highlights)	🟢
Release ticket is cut, and there's a forum post announcing the start of the window	🟢
Any necessary security reviews are complete	🟢

OpenSearch 2.15.0 exit criteria status:

Criteria	Status	Description	Comments
Performance tests are run, results are posted to the release ticket and there no unexpected regressions	🟢
No unpatched vulnerabilities of medium or higher severity that have been publicly known for more than 60 days	🟢
Documentation has been fully reviewed and signed off by the documentation community.	🟢
All integration tests are passing	🟢
Release blog is ready	🟢

OpenSearch-Dashboards 2.15.0 exit criteria status:

Criteria	Status	Description	Comments
Documentation has been fully reviewed and signed off by the documentation community	🟢
No unpatched vulnerabilities of medium or higher severity that have been publicly known for more than 60 days	🟢
All integration tests are passing	🟢
Release blog is ready	🟢

Preparation

• Release manager assigned.
  • @peterzhuamazon
  • @zelinh
• Update release page on the website with release manager and release issue details. Sample PR
  • Adding 2.15.0 release events to the website project-website#2932
• Existence of label in each component repo. For more information check the release-label section.
• Increase the build frequency.
  • Update github ci checks opensearch build image to al2 #4744
• Release Issue.

Campaigns

• Component Release Issue.
• Release Campaigns.
  • [RELEASE]: Stabilize the integration test runs for distribution builds, no manual sign-offs anymore #4588

Release Branch and Version Increment - Ends 2024/06/10 4PM PST

• Core Release Branch.
• Core Version Increment.
  • Bump 2.x to 2.16.0 OpenSearch#14216
  • Bump 2.x to 2.16.0 OpenSearch-Dashboards#7012
• Components Release Branch.
• Components Version Increment.

Feature Freeze - Ends 2024/06/11 4PM PST

• OpenSearch / OpenSearch-Dashboards core and components teams finalize their features.

Code Complete - Ends 2024/06/11 4PM PST

• Mark this as done once the Code Complete is reviewed.
• Create/Verify pull requests to add each component to relase input manifests/2.15.0/opensearch-2.15.0.yml and manifests/2.15.0/opensearch-dashboards-2.15.0.yml.

Release Candidate Creation and Testing - Starts 2024/06/11 after 4PM

• Generate Release Candidate.
• Integ Test TAR.
• Integ Test RPM.
• Docker Build and Scan.
• Backwards Compatibility Tests.
• Windows Integration Test.
• Broadcast and Communication.
• Release Candidate Lock.

Performance testing validation - Starts 2024/06/11

• Post the benchmark-tests
• Longevity tests do not show any issues.

Pre Release

• Release Labeled Issues.
• Go or No-Go.
  • https://opensearch.org/events/2024-0625-2-15-release-meetings/
• Promote Repos.
• Promote artifacts.
• Release Notes.
  • Adding the 2.15.0 consolidated release notes #4789

Release - 2024/06/25

• Maven Promotion.
• Docker Promotion.
• Release Validation.
• Collaboration with the Project Management Team.

Release Checklist.

Release Checklist

Pre-Release activities

• Promote Repos.
  • • OS
  • • OSD
• Promote Artifacts.
  • • Windows
  • • Linux Debian
  • • Linux RPM
  • • Linux TAR
• Consolidated Release Notes.
  • Adding the 2.15.0 consolidated release notes #4789

Release activities

• Docker Promotion.
• Release Validation part 1.
  • • OpenSearch and OpenSearch Dashboard Validation.
  • • Validate the native plugin installation.
• Merge consolidated release notes PR.
• Website and Documentation Changes.
  • • Merge staging website PR.
      • [Merge only during Release Call] 2.15 Release Artifacts project-website#3007
  • • Promote the website changes to prod.
  • • Add website alert.
      • 2.15 Hero Banner project-website#3008
• Release Validation part 2.
  • • Validate the artifact download URL's and signatures.
• Release Validation part 3.
  • • Trigger the validation build (Search for Completed validation for <> in the logs).
• Maven Promotion.
• Publish blog posts.
  • 2.15 downloads, blog, & announcement, link update project-website#3011
• Advertise on Social Media.
• Post on public slack and Github Release issue.

Post-Release activities

• Release Tags.
• Input Manifest Update.
• Decrease the Build Frequency.
• OpenSearch Build Release notes.
• Retrospective Issue.
  • [Retrospective] Release Version 2.15.0 #4786
• Helm and Ansible Playbook release.
  • Update 2.x chart to use 2.15.0 release helm-charts#552
  • [RELEASE] Release version 2.15.0 #4681
• Upcoming Release Preparation.

Post Release

• Release Tags.
• Input Manifest Update.
  • Switch 2.15.0 input manifest from commit ids to tags #4800
• OpenSearch Build Release notes.
• Decrease the Build Frequency.
• Retrospective Issue.
  • [Retrospective] Release Version 2.15.0 #4786
• Helm and Ansible Playbook release.
  • Update 2.x chart to use 2.15.0 release helm-charts#552
  • [RELEASE] Release version 2.15.0 #4681
• Upcoming Release Preparation.

Components

OpenSearch

Component	Issues tagged with 2.15.0
opensearch-project/OpenSearch#13547
opensearch-project/common-utils#652
opensearch-project/job-scheduler#627
opensearch-project/security#4318
opensearch-project/k-NN#1690
opensearch-project/geospatial#656
opensearch-project/cross-cluster-replication#1384
opensearch-project/ml-commons#2406
opensearch-project/neural-search#732
opensearch-project/notifications#919
opensearch-project/observability#1827
opensearch-project/reporting#997
opensearch-project/sql#2656
opensearch-project/asynchronous-search#570
opensearch-project/anomaly-detection#1204
opensearch-project/alerting#1545
opensearch-project/security-analytics#1018
opensearch-project/index-management#1170
opensearch-project/performance-analyzer#653
opensearch-project/performance-analyzer-rca#550
opensearch-project/custom-codecs#143
opensearch-project/flow-framework#706
opensearch-project/skills#312

OpenSearch Dashboards

Component	Issues tagged with 2.15.0
opensearch-project/OpenSearch-Dashboards#6718
opensearch-project/opensearch-dashboards-functional-test#1269
opensearch-project/dashboards-observability#1820
opensearch-project/dashboards-reporting#352
opensearch-project/dashboards-visualizations#366
opensearch-project/dashboards-query-workbench#322
opensearch-project/dashboards-maps#619
opensearch-project/anomaly-detection-dashboards-plugin#756
opensearch-project/ml-commons-dashboards#327
opensearch-project/index-management-dashboards-plugin#1059
opensearch-project/dashboards-notifications#204
opensearch-project/alerting-dashboards-plugin#948
opensearch-project/security-analytics-dashboards-plugin#1005
opensearch-project/security-dashboards-plugin#1938
opensearch-project/dashboards-search-relevance#393
opensearch-project/dashboards-assistant#189

Legend

Symbol	Meaning
🟢	On track with overall release
🟡	Missed last milestone
🔴	Missed multiple milestones

Issues / PRs:

• [BUG] Huge JVM Heap Usage OpenSearch#13927
  • [Backport 2.x] Bump jackson from 2.17.0 to 2.17.1 OpenSearch#13823
• Adding 2.15.0 release events to the website project-website#2932
• Update configs and entrypoint for logging.ignoreEnospcError in 2.15.0 #4695
• Update 2.x to 2.15.0 security-analytics#1055
• Update 2.x to 2.15.0 dashboards-observability#1874
• Update 2.x to 2.15.0 anomaly-detection-dashboards-plugin#769
• Update json5 dependency OpenSearch-Dashboards#6937
  • [Backport 2.x] Update json5 dependency OpenSearch-Dashboards#6946
• Run promotion jobs in parallel #4747
• [Infra] Add CI groups for OSD core test cases to avoid flaky test opensearch-dashboards-functional-test#1352
• Create 2.15.0 test manifest + add async search bwc tests #4720
• [BUG] During proxy-based authentication, remoteIpHeader seems not being verified against internalProxies security#4414
• Update Frontend for Custom Result Index Query and Fix Issues anomaly-detection-dashboards-plugin#772
• Add changelog for PR 6954 OpenSearch-Dashboards#6979
• [GHSA-x565-32qp-m3vf] Bump jimp to remove phin dependency OpenSearch-Dashboards#6977
• Add missing aria-label for discover page OpenSearch-Dashboards#6898
• [OE] Support compression for requests OpenSearch-Dashboards#6366
• Move 2.15.0 RC generation date to 2024/06/11 project-website#2955
• Push 2.15.0 RC1 generation date change to prod env project-website#2956
• Add additional workflows to central promotion workflows #4753
• Delete stale index routing files. OpenSearch#13909
• Switch manifest to use specific branch 2.15 #4759
• [AUTOCUT] Distribution Build Failed for performance-analyzer-2.15.0 performance-analyzer#663
  • Bump PA commons to version 1.4.0 for 2.15.0 and PA-RTF changes performance-analyzer-commons#78
  • Correct codeowner file to unblock release and issue naming performance-analyzer-commons#79
  • Bump PA to use 1.4.0 PA commons lib performance-analyzer#664
  • Bump PA-RCA to use 1.4.0 PA commons lib performance-analyzer-rca#557
  • Manual approval required for workflow run 9472277700: Release performance-analyzer-commons version=1.4.0 performance-analyzer-commons#80
• [BUG] CI failing on Linux with Java runtime error k-NN#1737
  • Revert centos7 to al2 changes due to issues in 2.15.0 #4760
• [RELEASE]: Stabilize the integration test runs for distribution builds, no manual sign-offs anymore #4588
  • [Infra] Add CI groups for OSD core test cases to avoid flaky test opensearch-dashboards-functional-test#1352
• Apply the date histogram rewrite optimization to range aggregation OpenSearch#13865
• [Backport 13821] Support Dynamic Pruning in Cardinality Aggregation OpenSearch#14203
• Support Dynamic Pruning in Cardinality Aggregation OpenSearch#13821
• Fix Flaky Discover Table Tests opensearch-dashboards-functional-test#1377
• Fix flaky tests in core dashboard. opensearch-dashboards-functional-test#1371
• [Backport 2.x] Block delete model requests if an index uses the model k-NN#1745
• Alerting Enhancements: Alerting Comments (Experimental) alerting#1561
  • [Backport 2.15] [Backport 2.x] Alerting Enhancements: Alerting Comments (Experimental) (#1561) alerting#1573
• [Backport 2.x] Add release notes for 2.15 security-dashboards-plugin#1997
• Read write ephemeral objects for remote publication of cluster state OpenSearch#14089
• [Backport 2.x]Delete stale index routing table files resolves #14162 (#13909) OpenSearch#14195
• Add multi modal default preprocess function ml-commons#2500
• Support Dynamic Pruning in Cardinality Aggregation OpenSearch#13821
• [BUG] sporadic concurrent_modification_exception during query in 2.14 OpenSearch#14032
• [BUG] ShardNotFoundException during IndicesRequestCache clean up OpenSearch#14190
  • [Backport 2.15] Fix ShardNotFoundException during request cache clean up OpenSearch#14233
• [Backport 2.x] bug fixes for correlation Alerts common-utils#680
• [Backport-2.x] Backport fix bedrock preprocess func ml-commons#2537
• Make sure processPostCollection is called in case of early termination OpenSearch#14208
  • [Backport 2.15] Make sure processPostCollection is called in case of early termination OpenSearch#14214
• Add support to validate both docker and ECR as image source  #4762
• [2.15.0] Manifest Commit Lock with action MATCH_BUILD_MANIFEST #4764
• Docs Pending: https://github.com/opensearch-project/documentation-website/issues?q=is%3Aissue+is%3Aopen+label%3Av2.15.0
• SA possible feature
• Flow Framework Jarhell: Trace analytics cypress update for 2.15 opensearch-dashboards-functional-test#1376 (comment) 3.0 only
• Increase jvm heap size of test cluster from default 1G to 2G for integration tests.  #4662 (comment)
• Add condition for OSD integ tests on deb and rpm #4770
• Raise osd integTest timeout to 6 hours due to OSD core length #4779
• Move 2.15.0 release notes to correct location performance-analyzer#674
• Fix custom model IT failure on windows ml-commons#505 (comment)
• ARM64 CentOS7 compatibility issues with djl/pytorch due to glibc requirements ml-commons#2563
• Update go/nogo meeting dates for 2.15.0 project-website#2972
• [AUTOCUT] Integration Test failed for index-management: 2.15.0 index-management#1185
  • Remove static metaFields list and get version-specific values from core security#4370
  • [2.15] Revert "[Backport 2.x] Remove static metaFields list and get version-specific values from core" security#4474
• Update go/nogo meeting dates for 2.15.0 (Part 2) project-website#2974
• [BUG] Potential Cluster Slowdown/Lags after merging #13748(#14348) #14338(#14391) in 2.15 OpenSearch#14442
• Correct 2.15.0 meeting time on the go/nogo call project-website#2978
• [2.15] Cypress Fix for few flaky tests in index-management dashboard plugin during Jenkins executions opensearch-dashboards-functional-test#1419
• [2.15.0] Manifest Commit Lock with action UPDATE_TO_RECENT_COMMITS #4793
• Make endpoint_string one line for ccr test #4794
• Increase osd integTest timeout to 6 hours for OSD core #4795
• Reduce Windows script 127 issues after switching from servercore to server images opensearch-ci#433
• Add 2.15.0 second go/nogo meeting on 06/24 project-website#2995
• Additional wait will allow the page to render opensearch-dashboards-functional-test#1425
• Split OSD tests by CI group #4745
  • [Enhancement] Onboard Jenkins CI Docker Images to FTrepo opensearch-dashboards-functional-test#1430
  • [Enhancement] Random failure on embed.spec.js due to click too early opensearch-dashboards-functional-test#1431
  • [Infra] Add CI groups for OSD core test cases to avoid flaky test opensearch-dashboards-functional-test#1352
  • Fix flaky tests in core dashboard. opensearch-dashboards-functional-test#1371
  • fix data source flaky tests opensearch-dashboards-functional-test#1383
  • Add env_var params to allow customizing runs on ftrepo tests opensearch-dashboards-functional-test#1428
  • feat: reuse specs finder opensearch-dashboards-functional-test#1411
  • add ci-groups changes for OSD tests #4796
  • Resolve multiple OSD core test issues observed in 2.15.0 opensearch-dashboards-functional-test#1432
  • Add cleanup for the data dir after integtests #4798
• Update launch meeting dates and chime id for 2.15.0 release project-website#3004
• Update 2.15.0 retro chime link and time information project-website#3017
• All Autocuts: [RELEASE] Release version 2.15.0 #4681 (comment)
• OS Plugins Release Notes: [RELEASE] Release version 2.15.0 #4681 (comment)
• OSD Plugins Release Notes: [RELEASE] Release version 2.15.0 #4681 (comment)
• RC1: [RELEASE] Release version 2.15.0 #4681 (comment)
• RC2 PRs: [RELEASE] Release version 2.15.0 #4681 (comment)
• RC2: [RELEASE] Release version 2.15.0 #4681 (comment)
• RC3 PRs: [RELEASE] Release version 2.15.0 #4681 (comment)
• RC3: [RELEASE] Release version 2.15.0 #4681 (comment)
• RC4 PRs: [RELEASE] Release version 2.15.0 #4681 (comment)
• RC4: [RELEASE] Release version 2.15.0 #4681 (comment)
• RC5 PRs: [RELEASE] Release version 2.15.0 #4681 (comment)
• RC5: [RELEASE] Release version 2.15.0 #4681 (comment)
• RC5 IntegTests: [RELEASE] Release version 2.15.0 #4681 (comment)
• Performance Test: [RELEASE] Release version 2.15.0 #4681 (comment)

Links

• Open PRs: https://github.com/pulls?q=is%3Aopen+is%3Apr+archived%3Afalse+user%3Aopensearch-project+label%3Av2.15.0
• Open Issues: https://github.com/issues?q=is%3Aopen+is%3Aissue+archived%3Afalse+user%3Aopensearch-project+label%3Av2.15.0
• Docs Pending: https://github.com/opensearch-project/documentation-website/issues?q=is%3Aissue+is%3Aopen+label%3Av2.15.0

• Updating

[shwetathareja]

@peterzhuamazon do we have plans to cut RC6?
This one line change PR needs to be merged - opensearch-project/OpenSearch#14488

[kolchfa-aws]

All OpenSearch 2.15 documentation PRs are merged and we're ready for the release.

[peterzhuamazon]

We are a GO ✅ to launch the 2.15.0 release.
Thanks everyone who contribute and help support this release.

We have the 2.15.0 Launch Meeting happening at 2:00PM PST 06/25 Today!
https://opensearch.org/events/2024-0625-2-15-release-meetings/

You can join the meeting with these info:

Join Meeting

Click to join the meeting: https://chime.aws/7306222022

Meeting ID: 7306222022

A headset is recommended or you may use your computer's microphone and speakers.

Call in using your phone:

    United States Toll-Free (1): +1 855-552-4463
    United States (1): +1 206-462-5569
    International: https://chime.aws/dialinnumbers/

Dial-in attendees must enter *7 to mute or unmute themselves.

Thanks.

[peterzhuamazon]

Sha verifications:

% gpg --verify opensearch-2.15.0-linux-x64.tar.gz.sig
gpg: Signature made Tue 25 Jun 2024 09:42:26 PM UTC using RSA key ID 542C03B4
gpg: Good signature from "OpenSearch project <opensearch@amazon.com>"
gpg: WARNING: This key is not certified with a trusted signature!
gpg:          There is no indication that the signature belongs to the owner.
Primary key fingerprint: C5B7 4989 65EF D1C2 924B  A9D5 39D3 1987 9310 D3FC
     Subkey fingerprint: 2187 3199 B103 0FCD 49DA  83F8 C2EE 2AF6 542C 03B4

[peterzhuamazon]

Native plugins:

 % ./opensearch-plugin install repository-s3
-> Installing repository-s3
-> Downloading repository-s3 from opensearch
[=================================================] 100%
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@     WARNING: plugin requires additional permissions     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
* java.io.FilePermission config#plus read
* java.lang.RuntimePermission accessDeclaredMembers
* java.lang.RuntimePermission getClassLoader
* java.lang.RuntimePermission setContextClassLoader
* java.lang.reflect.ReflectPermission suppressAccessChecks
* java.net.NetPermission setDefaultAuthenticator
* java.net.SocketPermission * connect,resolve
* java.util.PropertyPermission aws.configFile read,write
* java.util.PropertyPermission aws.sharedCredentialsFile read,write
* java.util.PropertyPermission opensearch.allow_insecure_settings read,write
* java.util.PropertyPermission opensearch.path.conf read,write
See http://docs.oracle.com/javase/8/docs/technotes/guides/security/permissions.html
for descriptions of what these permissions allow and the associated risks.

Continue with installation? [y/N]y
-> Installed repository-s3 with folder name repository-s3

[peterzhuamazon]

Maven released now:
https://repo1.maven.org/maven2/org/opensearch/opensearch/2.15.0/

[peterzhuamazon]

2.15.0 Release Now:

• https://opensearch.org/versions/opensearch-2-15-0.html
• https://opensearch.org/blog/diving-into-opensearch-2.15/

[peterzhuamazon]

Close this as 2.15.0 Release Retro is completed now.

Thanks.

[max-allan-cgr]

@peterzhuamazon I am not seeing a 2.15.0 release in the GitHub releases page yet.
https://github.com/opensearch-project/OpenSearch-Dashboards/releases?q=&expanded=true
As of right now, 2.14 is showing as "Latest". Is there some automation that has failed or a manual step missed? Or is it normal to take so long for a release to complete?