[RELEASE] Release version 1.2.1 #1290

peternied · 2021-12-10T19:50:58Z

Release OpenSearch and OpenSearch Dashboards 1.2.1

This is an out of band release, it will follow the release process but normal steps will be abbreviated

Preparation

Assign this issue to a release owner.
Document any new quality requirements or changes.
Create a version label in each component repo for this, and the next minor release.
Confirm that OpenSearch-Dashboards does not need an updated manifest

Development

Post Release

Create release tags for each component.
Replace refs in manifests/1.2.1 with tags.
Update this template with any new or missed steps.
Conduct a retrospective, and publish its results. [Retrospective] Release 1.2.1 #1314

The text was updated successfully, but these errors were encountered:

peternied · 2021-12-10T22:48:59Z

We need to rev all version number, will be adding a new checklist for all the version to be rebuild

peternied · 2021-12-11T05:03:55Z

Release candidate testing instructions

Use Docker-Compose to setup a cluster
- Download this gist as docker-compose.yml on your machine
- Get latest image versions docker-compose pull
- Start the cluster docker-compose up
OpenSearch docker
- Start without security
  - Docker command docker pull opensearchstaging/opensearch:1.2.1 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:1.2.1
  - Connect command curl https://localhost:9200
- Start with security
  - Docker command docker pull opensearchstaging/opensearch:1.2.1 && docker run -it -p 9200:9200 -e "discovery.type=single-node" opensearchstaging/opensearch:1.2.1
  - Connect command curl --insecure https://admin:admin@localhost:9200
Use TARs to deploy OpenSearch Manually
- OpenSearch - Build 53
  - x64 [manifest] [tar]
  - arm64 [manifest] [tar]

From Docker Release

peternied · 2021-12-11T05:40:46Z

Performance testing has been triggered, tracking numbers for the results.

5453d4e4-9f6c-439a-be0c-09878412905c
296bec5f-1b35-46c7-b9cd-2dc370546583
17ee8f29-e0b9-4a4e-b309-653adead9671
62ed636e-3a3b-48a8-9f5f-a1da78348c50

Update after reviewing results

Performance testing numbers are back, comparing 1.2.0 vs 1.2.1 the differences are within the margin of error of the testing framework. For the x64 we did see elevation in the range query latency which were not seen in arm64.

This is basically the same story that we have for the 1.2.0 testing, see opensearch-project/OpenSearch#1560 for additional background.

peternied · 2021-12-11T05:58:48Z

Integration testing kicked off - results will come tomorrow

./test.sh integ-test manifests/1.3.0/opensearch-1.3.0-test.yml --paths opensearch=https://ci.opensearch.org/ci/dbc/distribution-build-opensearch/1.2.1/53/linux/x64

./test.sh integ-test manifests/1.3.0/opensearch-1.3.0-test.yml -paths opensearch=https://ci.opensearch.org/ci/dbc/distribution-build-opensearch/1.2.1/53/linux/arm64

Seeing an issue with a gradle dependency #1304 not sure of a work around will pick this back up later.

Worked around the integration test issue results:

ARM

2021-12-11 18:41:35 INFO     | alerting             | with-security        | PASS  |    0 |
2021-12-11 18:41:35 INFO     | alerting             | without-security     | PASS  |    0 |
2021-12-11 18:41:35 INFO     | anomaly-detection    | with-security        | PASS  |    0 |
2021-12-11 18:41:35 INFO     | anomaly-detection    | without-security     | PASS  |    0 |
2021-12-11 18:41:35 INFO     | asynchronous-search  | with-security        | PASS  |    0 |
2021-12-11 18:41:35 INFO     | asynchronous-search  | without-security     | PASS  |    0 |
2021-12-11 18:41:35 INFO     | dashboards-reports   | without-security     | PASS  |    0 |
2021-12-11 18:41:35 INFO     | index-management     | with-security        | PASS  |    0 |
2021-12-11 18:41:35 INFO     | index-management     | without-security     | PASS  |    0 |
2021-12-11 18:41:35 ERROR    | k-NN                 | with-security        | FAIL  |    1 |
2021-12-11 18:41:35 INFO     | k-NN                 | without-security     | PASS  |    0 |
2021-12-11 18:41:35 INFO     | sql                  | with-security        | PASS  |    0 |
2021-12-11 18:41:35 INFO     | sql                  | without-security     | PASS  |    0 |

x64

2021-12-11 18:34:47 INFO     | alerting             | with-security        | PASS  |    0 |
2021-12-11 18:34:47 INFO     | alerting             | without-security     | PASS  |    0 |
2021-12-11 18:34:47 INFO     | anomaly-detection    | with-security        | PASS  |    0 |
2021-12-11 18:34:47 INFO     | anomaly-detection    | without-security     | PASS  |    0 |
2021-12-11 18:34:47 INFO     | asynchronous-search  | with-security        | PASS  |    0 |
2021-12-11 18:34:47 INFO     | asynchronous-search  | without-security     | PASS  |    0 |
2021-12-11 18:34:47 INFO     | dashboards-reports   | without-security     | PASS  |    0 |
2021-12-11 18:34:47 ERROR    | index-management     | with-security        | FAIL  |    1 |
2021-12-11 18:34:47 INFO     | index-management     | without-security     | PASS  |    0 |
2021-12-11 18:34:47 INFO     | k-NN                 | with-security        | PASS  |    0 |
2021-12-11 18:34:47 INFO     | k-NN                 | without-security     | PASS  |    0 |
2021-12-11 18:34:47 INFO     | sql                  | with-security        | PASS  |    0 |
2021-12-11 18:34:47 INFO     | sql                  | without-security     | PASS  |    0 |

k-NN failure was a known issue with test jvm not matching OpenSearch jvm

org.opensearch.knn.plugin.action.RestLegacyKNNStatsHandlerIT > testInvalidNodeIdStats FAILED
    org.opensearch.client.ResponseException: method [DELETE], host [https://localhost:9200], URI [/.ds-test-data-stream-000001], status line [HTTP/1.1 400 Bad Request]
    Warnings: [this request accesses system indices: [.opendistro_security], but in a future major version, direct access to system indices will be prevented by default]
    {"error":{"root_cause":[{"type":"illegal_argument_exception","reason":"index [.ds-test-data-stream-000001] is the write index for data stream [test-data-stream] and cannot be deleted"}],"type":"illegal_argument_exception","reason":"index [.ds-test-data-stream-000001] is the write index for data stream [test-data-stream] and cannot be deleted"},"status":400}

index-management failure did was from a flaky tests

Suite: Test class org.opensearch.indexmanagement.transform.resthandler.RestGetTransformActionIT
...
  2> REPRODUCE WITH: ./gradlew ':integTest' --tests "org.opensearch.indexmanagement.transform.resthandler.RestGetTransformActionIT.test getting all transforms" -Dtests.seed=FACC741DBC83E08E -Dtests.security.manager=false -Dtests.locale=uk-UA -Dtests.timezone=Europe/Minsk -Druntime.java=14
  2> org.opensearch.client.ResponseException: method [PUT], host [https://localhost:9200], URI [/_plugins/_transform/MsaBSOmAbD?refresh=true], status line [HTTP/1.1 500 Internal Server Error]
    {"error":{"root_cause":[{"type":"zone_rules_exception","reason":"Unknown time-zone ID: US/Pacific-New"}],"type":"zone_rules_exception","reason":"Unknown time-zone ID: US/Pacific-New"},"status":500}
    ```

peternied · 2021-12-11T16:42:00Z

Needed to work around an upload issue for #1261 RC artifacts have been uploaded

peterzhuamazon · 2021-12-11T19:06:12Z

Maven up: https://aws.oss.sonatype.org/content/repositories/releases/org/opensearch/opensearch/1.2.1/

Waiting for sync from the central: https://repo1.maven.org/maven2/org/opensearch/opensearch/1.2.1/

peterzhuamazon · 2021-12-11T19:14:44Z

All tar are pushed to production bucket.

peterzhuamazon · 2021-12-11T19:19:13Z

Native plugins live:

% ./bin/opensearch-plugin install repository-s3
-> Installing repository-s3
-> Downloading repository-s3 from opensearch
[=================================================] 100%
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@     WARNING: plugin requires additional permissions     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
* java.lang.RuntimePermission accessDeclaredMembers
* java.lang.RuntimePermission getClassLoader
* java.lang.reflect.ReflectPermission suppressAccessChecks
* java.net.SocketPermission * connect,resolve
* java.util.PropertyPermission opensearch.allow_insecure_settings read,write
See http://docs.oracle.com/javase/8/docs/technotes/guides/security/permissions.html
for descriptions of what these permissions allow and the associated risks.

Continue with installation? [y/N]y
-> Installed repository-s3 with folder name repository-s3

peterzhuamazon · 2021-12-11T19:33:16Z

Docker up:
https://hub.docker.com/r/opensearchproject/opensearch/tags

$ curl https://localhost:9200/ -u admin:admin --insecure
{
  "name" : "opensearch-node1",
  "cluster_name" : "opensearch-cluster",
  "cluster_uuid" : "teJylxlBQVKqXt_doKdSxQ",
  "version" : {
    "distribution" : "opensearch",
    "number" : "1.2.1",
    "build_type" : "tar",
    "build_hash" : "e3a44fa71b290fb265a94ef4297f044b9a63a762",
    "build_date" : "2021-12-11T04:24:30.324011Z",
    "build_snapshot" : false,
    "lucene_version" : "8.10.1",
    "minimum_wire_compatibility_version" : "6.8.0",
    "minimum_index_compatibility_version" : "6.0.0-beta1"
  },
  "tagline" : "The OpenSearch Project: https://opensearch.org/"
}
$ curl https://localhost:9200/_cat/plugins -u admin:admin --insecure
opensearch-node2 opensearch-alerting                  1.2.1.0
opensearch-node2 opensearch-anomaly-detection         1.2.1.0
opensearch-node2 opensearch-asynchronous-search       1.2.1.0
opensearch-node2 opensearch-cross-cluster-replication 1.2.1.0
opensearch-node2 opensearch-index-management          1.2.1.0
opensearch-node2 opensearch-job-scheduler             1.2.1.0
opensearch-node2 opensearch-knn                       1.2.1.0
opensearch-node2 opensearch-observability             1.2.1.0
opensearch-node2 opensearch-performance-analyzer      1.2.1.0
opensearch-node2 opensearch-reports-scheduler         1.2.1.0
opensearch-node2 opensearch-security                  1.2.1.0
opensearch-node2 opensearch-sql                       1.2.1.0
opensearch-node1 opensearch-alerting                  1.2.1.0
opensearch-node1 opensearch-anomaly-detection         1.2.1.0
opensearch-node1 opensearch-asynchronous-search       1.2.1.0
opensearch-node1 opensearch-cross-cluster-replication 1.2.1.0
opensearch-node1 opensearch-index-management          1.2.1.0
opensearch-node1 opensearch-job-scheduler             1.2.1.0
opensearch-node1 opensearch-knn                       1.2.1.0
opensearch-node1 opensearch-observability             1.2.1.0
opensearch-node1 opensearch-performance-analyzer      1.2.1.0
opensearch-node1 opensearch-reports-scheduler         1.2.1.0
opensearch-node1 opensearch-security                  1.2.1.0
opensearch-node1 opensearch-sql                       1.2.1.0

peternied · 2021-12-11T20:38:37Z

The 1.2.1 release is live everywhere!

peternied · 2021-12-14T17:09:31Z

Teams need to create release tag for OpenSearch 1.2.1. After this is done please reply to this thread so we can update so I can coordinate updating the build ecosystem. The list of components that need updates follow

OpenSearch
common-utils
job-scheduler
alerting
asynchronous-search
index-management
k-NN
✅ security - Thanks to @davidlago for leading this change!
performance-analyzer
anomaly-detection
cross-cluster-replication
sql
dashboards-reports
opensearch-observability

peternied self-assigned this Dec 10, 2021

peternied added the release label Dec 10, 2021

dblock added the v1.2.1 label Dec 10, 2021

dblock mentioned this issue Dec 10, 2021

[RELEASE] Release version 1.1.1 #870

Closed

30 tasks

dblock pinned this issue Dec 10, 2021

peternied mentioned this issue Dec 10, 2021

Update opensearch core reference to 1.2 build #1294

Merged

1 task

peterzhuamazon assigned peternied and peterzhuamazon and unassigned peternied Dec 11, 2021

peternied mentioned this issue Dec 11, 2021

Release notes for OpenSearch 1.2.1 #1312

Merged

1 task

peternied mentioned this issue Dec 14, 2021

Updated manifest for 1.2.1 with tags #1326

Merged

15 tasks

dblock unpinned this issue Dec 15, 2021

dblock pinned this issue Dec 15, 2021

peterzhuamazon unpinned this issue Dec 17, 2021

peternied closed this as completed Jan 5, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[RELEASE] Release version 1.2.1 #1290

[RELEASE] Release version 1.2.1 #1290

peternied commented Dec 10, 2021 •

edited

Loading

peternied commented Dec 10, 2021

peternied commented Dec 11, 2021 •

edited

Loading

peternied commented Dec 11, 2021 •

edited

Loading

peternied commented Dec 11, 2021 •

edited

Loading

peternied commented Dec 11, 2021

peterzhuamazon commented Dec 11, 2021

peterzhuamazon commented Dec 11, 2021

peterzhuamazon commented Dec 11, 2021

peterzhuamazon commented Dec 11, 2021

peternied commented Dec 11, 2021

peternied commented Dec 14, 2021

[RELEASE] Release version 1.2.1 #1290

[RELEASE] Release version 1.2.1 #1290

Comments

peternied commented Dec 10, 2021 • edited Loading

Release OpenSearch and OpenSearch Dashboards 1.2.1

Preparation

Development

Post Release

peternied commented Dec 10, 2021

peternied commented Dec 11, 2021 • edited Loading

Release candidate testing instructions

peternied commented Dec 11, 2021 • edited Loading

Performance testing has been triggered, tracking numbers for the results.

Update after reviewing results

peternied commented Dec 11, 2021 • edited Loading

Integration testing kicked off - results will come tomorrow

Worked around the integration test issue results:

peternied commented Dec 11, 2021

peterzhuamazon commented Dec 11, 2021

peterzhuamazon commented Dec 11, 2021

peterzhuamazon commented Dec 11, 2021

peterzhuamazon commented Dec 11, 2021

peternied commented Dec 11, 2021

peternied commented Dec 14, 2021

peternied commented Dec 10, 2021 •

edited

Loading

peternied commented Dec 11, 2021 •

edited

Loading

peternied commented Dec 11, 2021 •

edited

Loading

peternied commented Dec 11, 2021 •

edited

Loading