[RELEASE] Release version 1.3.19

[github-actions]

Release OpenSearch and OpenSearch Dashboards 1.3.19

I noticed that a manifest was automatically created in manifests/1.3.19. Please follow the following checklist to make a release.

How to use this issue

This Release Issue

This issue captures the state of the OpenSearch release, its assignee (Release Manager) is responsible for driving the release. Please contact them or @mention them on this issue for help. There are linked issues on components of the release where individual components can be tracked. For more information check the the Release Process OpenSearch Guide.

Please refer to the following link for the release version dates: Release Schedule and Maintenance Policy.

Entrance Criteria

Criteria	Status	Description	Comments
Documentation draft PRs are up and in tech review for all component changes	🟢
Sanity testing is done for all components	🟢
Code coverage has not decreased (all new code has tests)	🟢
Release notes are ready and available for all components	🟢
Roadmap is up-to-date (information is available to create release highlights)	🟢
Release ticket is cut, and there's a forum post announcing the start of the window	🟢
Any necessary security reviews are complete	🟢

OpenSearch 1.3.19 exit criteria status:

Criteria	Status	Description	Comments
Performance tests are run, results are posted to the release ticket and there no unexpected regressions	🟢
No unpatched vulnerabilities of medium or higher severity that have been publicly known for more than 60 days	🟢
Documentation has been fully reviewed and signed off by the documentation community.	🟢
All integration tests are passing	🟢
Release blog is ready	🟢

OpenSearch-Dashboards 1.3.19 exit criteria status:

Criteria	Status	Description	Comments
Documentation has been fully reviewed and signed off by the documentation community	🟢
No unpatched vulnerabilities of medium or higher severity that have been publicly known for more than 60 days	🟢
All integration tests are passing	🟢
Release blog is ready	🟢

Preparation

• Release manager assigned.
• Update release page on the website with release manager and release issue details. Sample PR
• Existence of label in each component repo. For more information check the release-label section.
• Increase the build frequency.
• Release Issue.

Release Branch and Version Increment - _Ends August 20th

• Core Release Branch.
• Core Version Increment.
• Components Release Branch.
• Components Version Increment.

Feature Freeze - _Ends August 20th

• OpenSearch / OpenSearch-Dashboards core and components teams finalize their features.

Code Complete - _Ends August 20th

• Mark this as done once the Code Complete is reviewed.
• Create/Verify pull requests to add each component to relase input manifests/1.3.19/opensearch-1.3.19.yml and manifests/1.3.19/opensearch-dashboards-1.3.19.yml.

Release Candidate Creation and Testing - _Ends August 20th

• Generate Release Candidate.
• Integ Test TAR.
• Integ Test RPM.
• Docker Build and Scan.
• Backwards Compatibility Tests.
• Windows Integration Test.
• Broadcast and Communication.
• Release Candidate Lock.

Performance testing validation - _Ends August 21st

• Post the benchmark-tests
• Longevity tests do not show any issues.

Pre Release - _Ends August 26th

• Release Labeled Issues.
• Go or No-Go.
• Promote Repos.
• Promote artifacts.
• Release Notes.

Release - _Ends August 27th

• Maven Promotion.
• Docker Promotion.
• Release Validation.
• Collaboration with the Project Management Team.

Release Checklist.

Release Checklist

Pre-Release activities

• Promote Repos.
  • • OS
  • • OSD
• Promote Artifacts.
  • • Windows
  • • Linux Debian
  • • Linux RPM
  • • Linux TAR
• Consolidated Release Notes.

Release activities

• Docker Promotion.
• Release Validation part 1.
  • • OpenSearch and OpenSearch Dashboard Validation.
  • • Validate the native plugin installation.
• Merge consolidated release notes PR.
• Website and Documentation Changes.
  • • Merge staging website PR.
  • • Promote the website changes to prod.
  • • Add website alert.
• Release Validation part 2.
  • • Validate the artifact download URL's and signatures.
• Release Validation part 3.
  • • Trigger the validation build (Search for Completed validation for <> in the logs).
• Maven Promotion.
• Publish blog posts.
• Advertise on Social Media.
• Post on public slack and Github Release issue.

Post-Release activities

• Release Tags.
• Input Manifest Update.
• Decrease the Build Frequency.
• OpenSearch Build Release notes.
• Retrospective Issue.
• Helm and Ansible Playbook release.
• Upcoming Release Preparation.

Post Release

• Release Tags.
• Input Manifest Update.
• OpenSearch Build Release notes.
• Decrease the Build Frequency.
• Retrospective Issue.
• Helm and Ansible Playbook release.
• Upcoming Release Preparation.

Components

Replace with links to all component tracking issues.

Component	On track	Release Notes
{COMPONENT_ISSUE_LINK}	{INDICATOR}	{STATUS}

Legend

Symbol	Meaning
🟢	On track with overall release
🟡	Missed last milestone
🔴	Missed multiple milestones

• Updating

[dblock]

[Catch All Triage - 1, 2, 3]

[bshien]

I will be the release manager for this release.

[opensearch-ci-bot]

Core Components CommitID(after 2024-07-16) & Release Notes info

Repo	Branch	CommitID	Commit Date	Release Notes Exists
OpenSearch	[3ce0904c5e452a18ba343eecf04005bfd91b3249]	3ce0904	2024-08-19	False
OpenSearch-Dashboards	[b99d05001fde8845b04e11a2bc81ab0a8b785433]	b99d050	2024-08-19	False
alerting	[18c017b775b20cb2cb254a52dda09e3f4fde9171]	18c017b	2024-08-16	False
alertingDashboards	[83662abbb0f5fce1b9d573e3926dea73b1170b6c]	83662ab	2024-08-22	False
anomaly-detection	[1ebda2edf63f27b67ee0c7eb234ac726a93485c8]	1ebda2e	2024-08-21	True
anomalyDetectionDashboards	[a27802741cd6d27b7d2b1aaf3fd6447d9379ad9a]	a278027	2024-08-19	False
asynchronous-search	[3f7de96d839a04d5cd83d46a4a1417666c190618]	3f7de96	2024-08-19	False
common-utils	[211c19838bbd5be23e471d59e5f613d491aa6329]	211c198	2024-08-16	False
cross-cluster-replication	[c4d98c122706b1ab5add15f867e9877f4b916a71]	c4d98c1	2024-07-18	False
functionalTestDashboards	[1.3]	4b910f6	2024-08-19	False
ganttChartDashboards	[87a063a472715b6099e04f954d850cd2479b5e7e]	87a063a	2024-08-19	False
index-management	[b8f5da3072404a5dca761e616dea52e96604a604]	b8f5da3	2024-08-20	False
indexManagementDashboards	[3eb97703254b618e65de2d0497939ad071cedaca]	3eb9770	2024-08-19	False
job-scheduler	[53175b011dd6c92fe8681c5140bde828a9aef3d6]	53175b0	2024-07-30	False
k-NN	[430a374a4b787e1ec8b4ea289539d779d1dfc4bd]	430a374	2024-08-15	False
ml-commons	[05df353de9cee48de828fed825e41598c2ac7e4f]	05df353	2024-08-19	False
observabilityDashboards	[265ef309a2a9b31d8352a38ae8606115beab1c0f]	265ef30	2024-08-19	False
opensearch-observability	[d172eabdc05ec3f7aebd9035474354c84446423b]	d172eab	2024-08-19	False
opensearch-reports	[1fa195478242864313994b37ca6cb59d649ee080]	1fa1954	2024-08-19	False
performance-analyzer	[7cc894793c0ea8cdac01df5328b89d5bafeda69a]	7cc8947	2024-08-20	False
queryWorkbenchDashboards	[bd6b5a3142ee5184afa2d8e817f70671645db895]	bd6b5a3	2024-08-22	False
reportsDashboards	[54ae7aa5c05b27e02dc88b1f68b7a078261ddd44]	54ae7aa	2024-08-19	False
security	[c647ea13b640cf48ebf87cc4a534ee6556c9e45a]	c647ea1	2024-08-21	True
securityDashboards	[f779544a94c26f4efff1932a0d2d3ce744a455b8]	f779544	2024-08-21	True
sql	[332189c302420cd15afdfa3d4376800612a4e1f4]	332189c	2024-08-19	False

[bshien]

Release testing

We have built RC1 and it is ready for testing.

---

OpenSearch Docker
Start without security
Docker command docker pull docker pull opensearchstaging/opensearch:1.3.19.10203 && docker run -it -d -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:1.3.19.10203
Connect command curl http://localhost:9200/
Start with security
Docker command docker pull opensearchstaging/opensearch:1.3.19.10203 && docker run -it -d -p 9200:9200 -e "discovery.type=single-node" opensearchstaging/opensearch:1.3.19.10203
Connect command curl --insecure https://admin:admin@localhost:9200/
OpenSearch Dashboards Docker
Start without security
Docker command docker pull opensearchstaging/opensearch-dashboards:1.3.19.7878 && docker run -it -d --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:1.3.19.7878
URL http://localhost:5601/
Start with security
Docker command docker pull opensearchstaging/opensearch-dashboards:1.3.19.7878 && docker run -it -d --network="host" opensearchstaging/opensearch-dashboards:1.3.19.7878
URL http://localhost:5601/

Use Docker-Compose to setup a cluster

docker-compose.yml

    
version: '3'
services:
  opensearch-node1:
    image: opensearchstaging/opensearch:1.3.19.10203
    container_name: opensearch-node1
    environment:
      - cluster.name=opensearch-cluster
      - node.name=opensearch-node1
      - discovery.seed_hosts=opensearch-node1,opensearch-node2
      - cluster.initial_master_nodes=opensearch-node1,opensearch-node2
      - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping
      - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m" # minimum and maximum Java heap size, recommend setting both to 50% of system RAM
    ulimits:
      memlock:
        soft: -1
        hard: -1
      nofile:
        soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems
        hard: 65536
    volumes:
      - opensearch-data1:/usr/share/opensearch/data
    ports:
      - 9200:9200
      - 9600:9600 # required for Performance Analyzer
    networks:
      - opensearch-net
  opensearch-node2:
    image: opensearchstaging/opensearch:1.3.19.10203
    container_name: opensearch-node2
    environment:
      - cluster.name=opensearch-cluster
      - node.name=opensearch-node2
      - discovery.seed_hosts=opensearch-node1,opensearch-node2
      - cluster.initial_master_nodes=opensearch-node1,opensearch-node2
      - bootstrap.memory_lock=true
      - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m"
    ulimits:
      memlock:
        soft: -1
        hard: -1
      nofile:
        soft: 65536
        hard: 65536
    volumes:
      - opensearch-data2:/usr/share/opensearch/data
    networks:
      - opensearch-net
  opensearch-dashboards:
    image: opensearchstaging/opensearch-dashboards:1.3.19.7878
    container_name: opensearch-dashboards
    ports:
      - 5601:5601
    expose:
      - "5601"
    environment:
      OPENSEARCH_HOSTS: '["https://opensearch-node1:9200/","https://opensearch-node2:9200/"]'
    networks:
      - opensearch-net
volumes:

opensearch-data1:

opensearch-data2:
networks:

opensearch-net:

Download the above docker-compose.yml on your machine.

Get latest image versions docker-compose pull.
Start the cluster docker-compose up.

Use below artifacts to deploy OpenSearch and OpenSearch Dashboards on different platforms

OpenSearch - Build 10203

x64 artifacts: [manifest] [tar] [rpm] [yum] [windows]

arm64 artifacts: [manifest] [tar] [rpm] [yum]

OpenSearch Dashboards - Build 7878

x64 artifacts: [manifest] [tar] [rpm] [yum] [windows]

arm64 artifacts: [manifest] [tar] [rpm] [yum]

Integration Test Results

• For the detailed integration test failures for RC1, OpenSearch (10203) Use this Metrics Dashboard Link
• For the detailed integration test failures for RC1, OpenSearch Dashboards (7878) Use this Metrics Dashboard Link

Thanks!

[bshien]

Release v1.3.19 Current Status - RC3

Integration test failure issues:

Plugin teams please go through the issues and try to close them as soon as possible
https://github.com/issues?q=is%3Aopen+is%3Aissue+user%3Aopensearch-project+label%3Av1.3.19+label%3Aautocut+%5BAUTOCUT%5D+in%3Atitle+

OpenSearch

The distribution build https://build.ci.opensearch.org//blue/organizations/jenkins/distribution-build-opensearch/detail/distribution-build-opensearch/10212/pipeline is SUCCESS

• Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test/detail/integ-test/8575/pipeline
  Distribution Type: x64 zip
  Failed Components: index-management, k-NN, ml-commons, anomaly-detection, asynchronous-search, alerting, sql
• Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test/detail/integ-test/8574/pipeline
  Distribution Type: arm64 rpm
• Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test/detail/integ-test/8573/pipeline
  Distribution Type: arm64 deb
• Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test/detail/integ-test/8572/pipeline
  Distribution Type: arm64 tar
• Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test/detail/integ-test/8571/pipeline
  Distribution Type: x64 deb
  Failed Components: index-management
• Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test/detail/integ-test/8570/pipeline
  Distribution Type: x64 rpm
  Failed Components: index-management
• Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test/detail/integ-test/8569/pipeline
  Distribution Type: x64 tar
  Failed Components: index-management

Docker Scan Results

The docker scan URL is https://build.ci.opensearch.org/job/docker-scan/3726/artifact/scan_docker_image.txt

OpenSearch Dashboards

The distribution build https://build.ci.opensearch.org//blue/organizations/jenkins/distribution-build-opensearch-dashboards/detail/distribution-build-opensearch-dashboards/7885/pipeline is SUCCESS

• Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/6316/pipeline
  Distribution Type: osd-1.3.19-7885 zip
  Failed Components: ganttChartDashboards, indexManagementDashboards, anomalyDetectionDashboards, securityDashboards, alertingDashboards, reportsDashboards, queryWorkbenchDashboards, observabilityDashboards
• Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/6315/pipeline
  Distribution Type: osd-1.3.19-7885 rpm
• Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/6314/pipeline
  Distribution Type: osd-1.3.19-7885 deb
  Failed Components: observabilityDashboards
• Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/6313/pipeline
  Distribution Type: osd-1.3.19-7885 rpm
  Failed Components: reportsDashboards, alertingDashboards
• Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/6312/pipeline
  Distribution Type: osd-1.3.19-7885 deb
  Failed Components: alertingDashboards, reportsDashboards
• Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/6311/pipeline
  Distribution Type: osd-1.3.19-7885 tar
  Failed Components: observabilityDashboards
• Integ Test Build URL: https://build.ci.opensearch.org//blue/organizations/jenkins/integ-test-opensearch-dashboards/detail/integ-test-opensearch-dashboards/6310/pipeline
  Distribution Type: osd-1.3.19-7885 tar
  Failed Components: reportsDashboards, anomalyDetectionDashboards, alertingDashboards, observabilityDashboards

Docker Scan Results

The docker scan URL is https://build.ci.opensearch.org/job/docker-scan/3727/artifact/scan_docker_image.txt

Pending PR’s with release label

https://github.com/issues?q=is%3Aopen+is%3Apr+user%3Aopensearch-project+label%3Av1.3.19+

Pending Issues with release label

https://github.com/issues?q=is%3Aopen+is%3Aissue+user%3Aopensearch-project+label%3Av1.3.19+

[bshien]

Release testing

We have built RC3 and it is ready for testing.

---

OpenSearch Docker
Start without security
Docker command docker pull docker pull opensearchstaging/opensearch:1.3.19.10212 && docker run -it -d -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:1.3.19.10212
Connect command curl http://localhost:9200/
Start with security
Docker command docker pull opensearchstaging/opensearch:1.3.19.10212 && docker run -it -d -p 9200:9200 -e "discovery.type=single-node" opensearchstaging/opensearch:1.3.19.10212
Connect command curl --insecure https://admin:admin@localhost:9200/
OpenSearch Dashboards Docker
Start without security
Docker command docker pull opensearchstaging/opensearch-dashboards:1.3.19.7885 && docker run -it -d --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:1.3.19.7885
URL http://localhost:5601/
Start with security
Docker command docker pull opensearchstaging/opensearch-dashboards:1.3.19.7885 && docker run -it -d --network="host" opensearchstaging/opensearch-dashboards:1.3.19.7885
URL http://localhost:5601/

Use Docker-Compose to setup a cluster

docker-compose.yml

    
version: '3'
services:
  opensearch-node1:
    image: opensearchstaging/opensearch:1.3.19.10212
    container_name: opensearch-node1
    environment:
      - cluster.name=opensearch-cluster
      - node.name=opensearch-node1
      - discovery.seed_hosts=opensearch-node1,opensearch-node2
      - cluster.initial_master_nodes=opensearch-node1,opensearch-node2
      - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping
      - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m" # minimum and maximum Java heap size, recommend setting both to 50% of system RAM
    ulimits:
      memlock:
        soft: -1
        hard: -1
      nofile:
        soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems
        hard: 65536
    volumes:
      - opensearch-data1:/usr/share/opensearch/data
    ports:
      - 9200:9200
      - 9600:9600 # required for Performance Analyzer
    networks:
      - opensearch-net
  opensearch-node2:
    image: opensearchstaging/opensearch:1.3.19.10212
    container_name: opensearch-node2
    environment:
      - cluster.name=opensearch-cluster
      - node.name=opensearch-node2
      - discovery.seed_hosts=opensearch-node1,opensearch-node2
      - cluster.initial_master_nodes=opensearch-node1,opensearch-node2
      - bootstrap.memory_lock=true
      - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m"
    ulimits:
      memlock:
        soft: -1
        hard: -1
      nofile:
        soft: 65536
        hard: 65536
    volumes:
      - opensearch-data2:/usr/share/opensearch/data
    networks:
      - opensearch-net
  opensearch-dashboards:
    image: opensearchstaging/opensearch-dashboards:1.3.19.7885
    container_name: opensearch-dashboards
    ports:
      - 5601:5601
    expose:
      - "5601"
    environment:
      OPENSEARCH_HOSTS: '["https://opensearch-node1:9200/","https://opensearch-node2:9200/"]'
    networks:
      - opensearch-net
volumes:

opensearch-data1:

opensearch-data2:
networks:

opensearch-net:

Download the above docker-compose.yml on your machine.

Get latest image versions docker-compose pull.
Start the cluster docker-compose up.

Use below artifacts to deploy OpenSearch and OpenSearch Dashboards on different platforms

OpenSearch - Build 10212

x64 artifacts: [manifest] [tar] [rpm] [yum] [windows]

arm64 artifacts: [manifest] [tar] [rpm] [yum]

OpenSearch Dashboards - Build 7885

x64 artifacts: [manifest] [tar] [rpm] [yum] [windows]

arm64 artifacts: [manifest] [tar] [rpm] [yum]

Integration Test Results

• For the detailed integration test failures for RC3, OpenSearch (10212) Use this Metrics Dashboard Link
• For the detailed integration test failures for RC3, OpenSearch Dashboards (7885) Use this Metrics Dashboard Link

Thanks!

[bshien]

We will be finalizing RC3 as the build to release. Thanks for everyone's support!

[bshien]

gpg --verify opensearch-1.3.19-linux-x64.tar.gz.sig
gpg: assuming signed data in 'opensearch-1.3.19-linux-x64.tar.gz'
gpg: Signature made Tue Aug 27 13:53:45 2024 PDT
gpg:                using RSA key C2EE2AF6542C03B4
gpg: Good signature from "OpenSearch project <opensearch@amazon.com>" [unknown]
gpg: WARNING: This key is not certified with a trusted signature!
gpg:          There is no indication that the signature belongs to the owner.
Primary key fingerprint: C5B7 4989 65EF D1C2 924B  A9D5 39D3 1987 9310 D3FC
     Subkey fingerprint: 2187 3199 B103 0FCD 49DA  83F8 C2EE 2AF6 542C 03B4

[bshien]

OpenSearch 1.3.19 has been released!
Maven is available at: https://repo1.maven.org/maven2/org/opensearch/opensearch/1.3.19/