Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RELEASE] Release version 2.2.0 #2271

Closed
42 of 48 tasks
github-actions bot opened this issue Jun 28, 2022 · 30 comments
Closed
42 of 48 tasks

[RELEASE] Release version 2.2.0 #2271

github-actions bot opened this issue Jun 28, 2022 · 30 comments
Assignees
Labels
release v2.2.0 Release 2.2.0

Comments

@github-actions
Copy link
Contributor

github-actions bot commented Jun 28, 2022

Release OpenSearch and OpenSearch Dashboards 2.2.0

I noticed that a manifest was automatically created in manifests/2.2.0. Please follow the following checklist to make a release.

How to use this issue

This Release Issue

This issue captures the state of the OpenSearch release, its assignee is responsible for driving the release. Please contact them or @mention them on this issue for help. There are linked issues on components of the release where individual components can be tracked. More details are included in the Maintainers Release owner section.

Release Steps

There are several steps to the release process, these steps are completed as the whole release and components that are behind present risk to the release. The release owner completes the tasks in this ticket, whereas component owners resolve tasks on their ticket in their repositories.

Steps have completion dates for coordinating efforts between the components of a release; components can start as soon as they are ready far in advance of a future release.

Component List

To aid in understanding the state of the release there is a table with status indicating each component state. This is updated based on the status of the component issues.

Preparation

  • Assign this issue to a release owner.
  • Declare a pencils down date for new features to be merged.
  • 2022/08/04 is pencils down date for feature freeze.
  • Update the Campaigns section to include monitoring campaigns during this release.
  • Update this issue so all __REPLACE_RELEASE-__ placeholders have actual dates.
  • Document any new quality requirements or changes.
  • Finalize scope and feature set and update the Public Roadmap.
  • Create a release issue in every component repo that links back to this issue, update Components section with these links.
  • Ensure the label is created in each component repo for this new version, and the next minor release. Create a version label
  • Ensure that all release issues created above are assigned to an owner in the component team.

CI/CD (Feature Freeze) - 2022/07/26 - 2022/08/04

  • Create Jenkins workflows that run daily snapshot builds for OpenSearch and OpenSearch Dashboards.
  • Increment each component version to 2.2.0 and ensure working CI in component repositories.
  • Make pull requests to add each component to manifests/2.2.0/opensearch-2.2.0.yml and manifests/2.2.0/opensearch-dashboards-2.2.0.yml with the corresponding checks.
  • OpenSearch / OpenSearch-Dashboards core and components teams finalize their features
  • OpenSearch / OpenSearch-Dashboards core cut branch 2.2 early.

Campaigns

Code Complete - 2022/07/26 - 2022/08/04

Release testing - 2022/08/05 - 2022/08/09

  • All components should have cut branch 2.2 for the release.
  • Declare a release candidate build, and provide the instructions with the release candidates for teams on testing (2022/08/05).
  • Stop builds for this version of OpenSearch and/or OpenSearch Dashboards in order to avoid accidental commits going in unknowingly. Restart only if necessary else manually run the build workflow and declare new release candidate.
  • Sanity Testing (2022/08/08 - 2022/08/09): Sanity testing and fixing of critical issues found by teams. Teams test their components within the distribution, ensuring integration, backwards compatibility, and perf tests pass.
  • Publish all test results in the comments of this issue.

Performance testing validation - 2022/08/08 - 2022/08/09

  • Performance tests do not show a regression
  • Longevity tests do not show any issues

Release - 2022/08/10 - 2022/08/11

Post Release

Components

Component On track Notes
opensearch-project/OpenSearch#4017 🟢 In manifest
opensearch-project/OpenSearch-Dashboards#1957 🟢 In manifest
opensearch-project/alerting#498 🟢 In manifest
opensearch-project/anomaly-detection#618 🟢 In manifest
opensearch-project/asynchronous-search#160 🟢 In manifest
opensearch-project/reporting#401 🟢 In manifest
opensearch-project/dashboards-visualizations#98 🟢 In manifest
opensearch-project/index-management#431 🟢 In manifest
opensearch-project/job-scheduler#214 🟢 In manifest
opensearch-project/k-NN#467 🟢 In manifest
opensearch-project/performance-analyzer#242 🟢 In manifest
opensearch-project/security-dashboards-plugin#1042 🟢 In manifest
opensearch-project/security#1969 🟢 In manifest
opensearch-project/sql#711 🟢 In manifest
opensearch-project/observability#894 🟢 In manifest
opensearch-project/alerting-dashboards-plugin#293 🟢 In manifest
opensearch-project/notifications#490 🟢 In manifest
opensearch-project/index-management-dashboards-plugin#217 🟢 In manifest
opensearch-project/anomaly-detection-dashboards-plugin#291 🟢 In manifest
opensearch-project/cross-cluster-replication#462 🟢 In manifest
opensearch-project/common-utils#206 🟢 In manifest
opensearch-project/ml-commons#374 🟢 In manifest
opensearch-project/geospatial#99 🟢 In manifest
opensearch-project/dashboards-maps#17 🟢 In manifest
Legend

Symbol Meaning
🟢 On track with overall release
🟡 Missed last milestone
🔴 Missed multiple milestones

Issue tracking (Updated 2022/08/05 21:31 PST)

State Total Bug Enhancement
Open 89 3 25
Closed 144 18 39

Issues:

@github-actions github-actions bot added release untriaged Issues that have not yet been triaged v{{ env.VERSION }} labels Jun 28, 2022
@prudhvigodithi
Copy link
Collaborator

[Triaged] Release 2.2.0 issue, more details will be added after 2.1.0.

@prudhvigodithi prudhvigodithi added v2.2.0 Release 2.2.0 and removed untriaged Issues that have not yet been triaged v{{ env.VERSION }} labels Jul 5, 2022
@zelinh
Copy link
Member

zelinh commented Jul 18, 2022

Two new plugins will be added to 2.2 release. #2346

@peternied
Copy link
Member

@opensearch-project/engineering-effectiveness there is no owner on this issue and the roadmap says the release is scheduled for the 11th - is there a new mechanism for tracking release processes or is this issue out of date?

@bbarani
Copy link
Member

bbarani commented Jul 25, 2022

This is a release template for major, minor and patch releases. Feature freeze / code complete is targeted for August 4, 2022 with release date set to August 11, 2022 for 2.2 release. @peterzhuamazon please update the template with these dates.

@peterzhuamazon peterzhuamazon self-assigned this Jul 25, 2022
@peterzhuamazon peterzhuamazon pinned this issue Jul 25, 2022
@peterzhuamazon
Copy link
Member

This is a release template for major, minor and patch releases. Feature freeze / code complete is targeted for August 4, 2022 with release date set to August 11, 2022 for 2.2 release. @peterzhuamazon please update the template with these dates.

I have added the dates now @bbarani will add the individual issues soon.

@peterzhuamazon
Copy link
Member

OSD 4048:

@kotwanikunal
Copy link
Member

Performance results comparison between OpenSearch 2.1 vs 2.2 version

Product/ Version Architecture Description Instance Type Workload Details Index Latency (ms) p50 Index Latency (ms) p90 Index Latency (ms) p99 Index Latency (ms) p100 Index Throughput (docs/s) p0 Index Throughput (docs/s) p50 Index Throughput (docs/s) p100 Index Throughput (docs/s) Ops Count Index Operation Counts Op Error Count Index Operation Counts Error Rate Query Latency (ms) p50 Query Latency (ms) p90 Query Latency (ms) p99 Query Latency (ms) p100 Query Throughput (docs/s) p0 Query Throughput (docs/s) p50 Query Throughput (docs/s) p100 Query Operation Counts Ops Count Query Operation Counts Op Error Count Error Rate****Query** Operation Counts** CPU (%) p50 CPU (%) p90 CPU (%) p99 CPU (%) p100 Memory (%) p50 Memory (%) p90 Memory (%) p99 Memory (%) p100 GC (ms) Old GC (ms) Young
OpenSearch - 2.1.0 X64 With Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 2,324.80 3,073.90 6,064.20 10,016.10 31,888.40 33,275.90 37,798.70 46,905 0 0 289.6 303.7 313.7 330.4 1.73 1.741 1.754 1,510 0 0 97 97 97 98 51.333 65 82.61 92 0 1,245,816
OpenSearch - 2.1.0 X64 Without Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 2,193.60 2,908.70 5,561.70 8,586 33,935.30 35,489.10 40,399.60 46,728 0 0 279.8 288.1 301.2 309.8 1.727 1.742 1.756 1,510 0 0 97 98 98 98 49 62 86.36 94 0 1,041,064
OpenSearch - 2.1.0 ARM64 With Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 1,916 2,524.20 4,626.10 6,358.80 38,446.80 40,096.30 43,909.90 46,468 0 0 363.8 372.5 379.1 385.6 1.686 1.707 1.754 1,510 0 0 96 97 97 97 50.333 65 81 90 0 917,896
OpenSearch - 2.1.0 ARM64 Without Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 1,668.20 2,223.30 4,057.60 6,691.20 44,384.30 46,221.20 50,871 45,960 0 0 351.9 361.3 366.5 368.3 1.709 1.732 1.755 1,510 0 0 96 97 97 97 47 63 82.58 93 0 822,345
OpenSearch - 2.2.0 X64 With Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 2,335.31 3,079.34 5,936.30 10,214.61 31,686.21 33,343.77 37,974.69 46,895 1 0 279.294 287.681 296.732 324.452 1.725 1.739 1.753 1,510 0 0 97 97 97 97 52.667 80.66 65.1 90 0 1,247,685
OpenSearch - 2.2.0 X64 Without Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 2,191.33 2,897.34 5,598.88 9,647.27 34,082.47 35,546.74 40,358.20 46,717 0 0 283.958 291.434 301.78 317.644 1.725 1.74 1.755 1,510 0 0 97 98 98 98 50 83.88 64 87 0 1,045,643
OpenSearch - 2.2.0 ARM64 With Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 1,883.37 2,479.36 4,604.23 7,402.89 39,028.32 40,765.93 44,511.18 46,419 0 0 342.469 366.734 373.616 380.034 1.693 1.717 1.75 1,510 0 0 96 97 97 97 50 89 64 94 0 974,866
OpenSearch - 2.2.0 ARM64 Without Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 1,706.20 2,266.16 4,083.58 6,656.40 43,532.26 45,223.83 49,498.55 46,049 0 0 414.607 426.393 434.969 444.161 1.667 1.705 1.751 1,510 0 0 96 97 97 97 49 78.78 64 94 0 812,093

@saratvemulapalli
Copy link
Member

saratvemulapalli commented Aug 10, 2022

Thanks @kotwanikunal. Looks like Indexing (P100) is >10% high, Querying on ARM without security >20% . Also memory seems inconsistent (P90 is higher than P99), is that an error in our computation or I am misunderstanding it?
But anyway as @dblock said, we are using up >20% memory (P90) compared to 2.1 which does not look right.

Were there any runs for opensearch-min (I assume all of these tests are for the bundle) ?

@peternied
Copy link
Member

memory seems inconsistent P90 is higher than P99

Is it possible those columns are transposed in the table? Those values look like they would swap cleanly and mirror the previous versions memory usage

@kavilla
Copy link
Member

kavilla commented Aug 10, 2022

AD test run after merged changes.

OSD 4048:

* Security confirm it is a known flaky test, @DarshitChanpura is fixing.

* AD Dashboards: [Adjust ad-dashboard historical page test and fix flaky tests opensearch-dashboards-functional-test#275](https://github.com/opensearch-project/opensearch-dashboards-functional-test/pull/275)

* OBS Dashboards:
     Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  core-opensearch-dashboards/opensear      00:27       34       34        -        -        - │
  │    ch-dashboards/dashboard_sanity_test                                                         │
  │    _spec.js                                                                                    │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      01:21        3        3        -        -        - │
  │    acknowledge_alerts_modal_spec.js                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      02:21        5        5        -        -        - │
  │    alert_spec.js                                                                               │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      01:23        2        2        -        -        - │
  │    alerts_dashboard_flyout_spec.js                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      01:14        3        3        -        -        - │
  │    bucket_level_monitor_spec.js                                                                │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      01:17        6        6        -        -        - │
  │    cluster_metrics_monitor_spec.js                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      01:35        7        7        -        -        - │
  │    query_level_monitor_spec.js                                                                 │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:17        1        1        -        -        - │
  │    s-plugin/create_detector_spec.js                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:21        8        8        -        -        - │
  │    s-plugin/dashboard_spec.js                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:09        5        5        -        -        - │
  │    s-plugin/detector_configuration_spe                                                         │
  │    c.js                                                                                        │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:22       11       11        -        -        - │
  │    s-plugin/detector_list_spec.js                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      01:10        6        6        -        -        - │
  │    s-plugin/historical_analysis_spec.j                                                         │
  │    s                                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:08        4        4        -        -        - │
  │    s-plugin/overview_spec.js                                                                   │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:09        2        2        -        -        - │
  │    s-plugin/real_time_results_spec.js                                                          │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:15        3        3        -        -        - │
  │    s-plugin/sample_detector_spec.js                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/custom-import-map-dashboard      00:22        1        1        -        -        - │
  │    s/import_vector_map_tab.spec.js                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/gantt-chart-dashboards/gant      00:50        9        9        -        -        - │
  │    t_ui.spec.js                                                                                │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/index-management-dashboards      00:27        3        3        -        -        - │
  │    -plugin/indices_spec.js                                                                     │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/index-management-dashboards      01:15        5        5        -        -        - │
  │    -plugin/managed_indices_spec.js                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/index-management-dashboards      00:32        5        5        -        -        - │
  │    -plugin/policies_spec.js                                                                    │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/index-management-dashboards      00:44        4        4        -        -        - │
  │    -plugin/rollups_spec.js                                                                     │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/index-management-dashboards      00:32        4        4        -        -        - │
  │    -plugin/transforms_spec.js                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/notifications-dashboards/1_      01:04       11       11        -        -        - │
  │    email_senders_and_groups.spec.js                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/notifications-dashboards/2_      01:27       13       13        -        -        - │
  │    channels.spec.js                                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/0_      00:08        1        1        -        -        - │
  │    before.spec.js                                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/1_      01:20        8        8        -        -        - │
  │    trace_analytics_dashboard.spec.js                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/2_      00:49        7        7        -        -        - │
  │    trace_analytics_services.spec.js                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/3_      00:44        7        7        -        -        - │
  │    trace_analytics_traces.spec.js                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/4_      02:26       25       25        -        -        - │
  │    panels.spec.js                                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/5_      05:06       36       36        -        -        - │
  │    event_analytics.spec.js                                                                     │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/6_      05:18       31       31        -        -        - │
  │    notebooks.spec.js                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  plugins/observability-dashboards/7_      10:01        8        7        1        -        - │
  │    app_analytics.spec.js                                                                       │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/8_       75ms        1        1        -        -        - │
  │    after.spec.js                                                                               │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/query-workbench-dashboards/      01:23       20       20        -        -        - │
  │    ui.spec.js                                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/reports-dashboards/01-creat      04:26       14       14        -        -        - │
  │    e.spec.js                                                                                   │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/reports-dashboards/02-edit.      01:24        3        3        -        -        - │
  │    spec.js                                                                                     │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/reports-dashboards/03-detai      02:06        6        6        -        -        - │
  │    ls.spec.js                                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/reports-dashboards/04-downl      01:16        5        5        -        -        - │
  │    oad.spec.js                                                                                 │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/audit_log_spec.js       00:09        4        4        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/auth_spec.js            00:05        2        2        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/get_started_spec.j      00:11        8        8        -        -        - │
  │    s                                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/internalusers_spec      00:10        4        4        -        -        - │
  │    .js                                                                                         │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/permissions_spec.j      00:16        5        5        -        -        - │
  │    s                                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/roles_spec.js           00:09        4        4        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/tenants_spec.js         00:08        2        2        -        -        - │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✖  1 of 45 failed (2%)                      57:40      356      355        1        -        -  

info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.

@DarshitChanpura
Copy link
Member

DarshitChanpura commented Aug 10, 2022

AD test run after merged changes.

All security dashboards tests are passing in this run.

@kotwanikunal
Copy link
Member

Thanks @kotwanikunal. Looks like Indexing (P100) is >10% high, Querying on ARM without security >20% . Also memory seems inconsistent (P90 is higher than P99), is that an error in our computation or I am misunderstanding it? But anyway as @dblock said, we are using up >20% memory (P90) compared to 2.1 which does not look right.

Were there any runs for opensearch-min (I assume all of these tests are for the bundle) ?

memory seems inconsistent P90 is higher than P99

Is it possible those columns are transposed in the table? Those values look like they would swap cleanly and mirror the previous versions memory usage

@peternied @saratvemulapalli
Interestingly enough, comparing with 2.0 with 2.2 does not show any major deviations.

The differences in memory consumption seem to be introduced in the results here.

Product/ Version Architecture Description Instance Type Workload Details Index Latency (ms) p50 Index Latency (ms) p90 Index Latency (ms) p99 Index Latency (ms) p100 Index Throughput (docs/s) p0 Index Throughput (docs/s) p50 Index Throughput (docs/s) p100 Index Throughput (docs/s) Ops Count Index Operation Counts Op Error Count Index Operation Counts Error Rate Query Latency (ms) p50 Query Latency (ms) p90 Query Latency (ms) p99 Query Latency (ms) p100 Query Throughput (docs/s) p0 Query Throughput (docs/s) p50 Query Throughput (docs/s) p100 Query Operation Counts Ops Count Query Operation Counts Op Error Count Error Rate****Query** Operation Counts** CPU (%) p50 CPU (%) p90 CPU (%) p99 CPU (%) p100 Memory (%) p50 Memory (%) p90 Memory (%) p99 Memory (%) p100 GC (ms) Old GC (ms) Young
OpenSearch - 2.0.0 X64 With Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 2,329.16 3,078.93 5,928.08 9,996.32 31,648.39 33,180.46 37,658.63 46,930 0 0 321.077 327.537 339.74 346.36 1.727 1.741 1.753 1,510 0 0 97 97 97.633 98 51 86.9 65 94 0 1,238,045
OpenSearch - 2.0.0 X64 Without Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 2,194.72 2,911.85 5,533.73 9,148.97 33,908.51 35,751.85 40,786.57 46,689 0 0 325.573 374.97 383.257 406.041 1.727 1.741 1.756 1,510 0 0 97 98 98 98 49 78.66 64 89 0 1,042,484
OpenSearch - 2.0.0 ARM64 With Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 1,836.63 2,425.53 4,603.91 7,938.29 39,916.78 41,835.35 46,370.79 46,309 0 0 377.718 388.623 394.611 477.491 1.685 1.711 1.737 1,510 0 0 96 97 97 97 52 81.08 66 94 0 979,516
OpenSearch - 2.0.0 ARM64 Without Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 1,583.90 2,119.10 4,072.69 6,760.69 46,667.65 48,219.27 53,191.03 45,795 0 0 420.445 434.06 439.104 442.699 1.697 1.725 1.754 1,510 0 0 96 97 97 97 50 85.89 63 95 0 816,215
OpenSearch - 2.2.0 X64 With Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 2,335.31 3,079.34 5,936.30 10,214.61 31,686.21 33,343.77 37,974.69 46,895 1 0 279.294 287.681 296.732 324.452 1.725 1.739 1.753 1,510 0 0 97 97 97 97 52.667 80.66 65.1 90 0 1,247,685
OpenSearch - 2.2.0 X64 Without Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 2,191.33 2,897.34 5,598.88 9,647.27 34,082.47 35,546.74 40,358.20 46,717 0 0 283.958 291.434 301.78 317.644 1.725 1.74 1.755 1,510 0 0 97 98 98 98 50 83.88 64 87 0 1,045,643
OpenSearch - 2.2.0 ARM64 With Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 1,883.37 2,479.36 4,604.23 7,402.89 39,028.32 40,765.93 44,511.18 46,419 0 0 342.469 366.734 373.616 380.034 1.693 1.717 1.75 1,510 0 0 96 97 97 97 50 89 64 94 0 974,866
OpenSearch - 2.2.0 ARM64 Without Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 1,706.20 2,266.16 4,083.58 6,656.40 43,532.26 45,223.83 49,498.55 46,049 0 0 414.607 426.393 434.969 444.161 1.667 1.705 1.751 1,510 0 0 96 97 97 97 49 78.78 64 94 0 812,093

The tests have been re-run to circumvent any flakiness between runs.

@saratvemulapalli
Copy link
Member

@kotwanikunal thats interesting. I am worried we either made improvements in 2.1 and probably loosing them in 2.2 or as @peternied suggested we are misreporting the columns.
I can't wrap my head around to have P90 higher and P99 being lower memory footprint. From what I see both 2.0 and 2.2 have the same format which seems suspicious.

@kavilla
Copy link
Member

kavilla commented Aug 11, 2022

Integ Test Result

OSD 4049
with-security-4049.txt
osd-with-security-screenshots-4049.zip

Videos of test failures:
7_app_analytics.spec.js.mp4.zip
historical_analysis_spec.js.mp4.zip

Click to expand the test logs here
yarn run v1.22.19
$ yarn cypress:run-with-security --browser electron --spec 'cypress/integration/core-opensearch-dashboards/opensearch-dashboards/*.js,cypress/integration/plugins/*/*'
$ env TZ=America/Los_Angeles NO_COLOR=1 cypress run --headless --env SECURITY_ENABLED=true,openSearchUrl=https://localhost:9200 --browser electron --spec 'cypress/integration/core-opensearch-dashboards/opensearch-dashboards/*.js,cypress/integration/plugins/*/*'
The experimentalNetworkStubbing configuration option was removed in Cypress version 6.0.0.

It is no longer necessary for using cy.intercept(). You can safely remove this option from your config.

====================================================================================================

  (Run Starting)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Cypress:        9.5.4                                                                          │
  │ Browser:        Electron 94 (headless)                                                         │
  │ Node Version:   v14.20.0 (/home/ubuntu/.nvm/versions/node/v14.20.0/bin/node)                   │
  │ Specs:          45 found (core-opensearch-dashboards/opensearch-dashboards/dashboard_sanity_te │
  │                 st_spec.js, plugins/alerting-dashboards-plugin/acknowledge_alerts_modal_spec.j │
  │                 s, plugins/alerting-dashboards-plugin/alert_spec.js, plugins/alerting-dashboar │
  │                 ds-plugin/alerts_dashbo...)                                                    │
  │ Searched:       cypress/integration/core-opensearch-dashboards/opensearch-dashboards/*.js, cyp │
  │                 ress/integration/plugins/*/*                                                   │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  core-opensearch-dashboards/opensearch-dashboards/dashboard_sanity_te           (1 of 45)
            st_spec.js                                                                              


  dashboard sample data validation
    checking home page
      ✓ checking opensearch_dashboards_overview display
      ✓ checking tutorial_directory display
      ✓ checking management display
      ✓ checking dev_tools display
      ✓ settings display
      ✓ checking feature_directory display
      ✓ checking navigation display
      ✓ checking Help menu display
    adding sample data
      ✓ checking ecommerce dashboards displayed (10914ms)
      ✓ checking flights dashboards displayed
      ✓ checking web logs dashboards displayed
      checking index patterns
        ✓ checking ecommerce index patterns are added
        ✓ checking flights index patterns are added
        ✓ checking web logs index patterns are added
      checking saved objects
        ✓ checking ecommerce object is saved
        ✓ checking flights object is saved
        ✓ checking web logs object is saved
      checking Visualize
        ✓ checking visualizations list display
        ✓ checking search bar display
        ✓ checking create visualization button display
      checking discover
        ✓ checking save query button display
        ✓ checking query input display
        ✓ checking refresh button display
        ✓ checking add filter button display
        ✓ checking index pattern switch button display
        ✓ checking field filter display
    checking Dev Tools
      ✓ checking welcome panel display
      ✓ checking dismiss button display
      ✓ checking console input area display
      ✓ checking console output area display
    checking stack management
      ✓ checking Stack Management display
      ✓ checking index patterns link display
      ✓ checking saved objects link display
      ✓ checking advance settings link display


  34 passing (29s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        34                                                                               │
  │ Passing:      34                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     28 seconds                                                                       │
  │ Spec Ran:     core-opensearch-dashboards/opensearch-dashboards/dashboard_sanity_test_spec.js   │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (2 seconds)
                          press/videos/core-opensearch-dashboards/opensearch-dashboar               
                          ds/dashboard_sanity_test_spec.js.mp4                                      


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/alerting-dashboards-plugin/acknowledge_alerts_modal_spec.js            (2 of 45)


  AcknowledgeAlertsModal
    ✓ Acknowledge button disabled when more than 1 trigger selected (67783ms)
    ✓ Bucket-level monitor modal test (7169ms)
    ✓ Query-level monitor modal test (6309ms)


  3 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 21 seconds                                                             │
  │ Spec Ran:     plugins/alerting-dashboards-plugin/acknowledge_alerts_modal_spec.js              │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (5 seconds)
                          press/videos/plugins/alerting-dashboards-plugin/acknowledge               
                          _alerts_modal_spec.js.mp4                                                 


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/alerting-dashboards-plugin/alert_spec.js                               (3 of 45)


  Alerts
    can be in 'Active' state
      ✓ after the monitor starts running (66894ms)
    can be in 'Acknowledged' state
      ✓ by clicking the button in Dashboard
    can be in 'Completed' state
      ✓ when the trigger condition is not met after met once (64648ms)
    can be in 'Error' state
      ✓ by using a wrong destination
    can be in 'Deleted' state
      ✓ by deleting the monitor


  5 passing (2m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        5                                                                                │
  │ Passing:      5                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     2 minutes, 21 seconds                                                            │
  │ Spec Ran:     plugins/alerting-dashboards-plugin/alert_spec.js                                 │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (8 seconds)
                          press/videos/plugins/alerting-dashboards-plugin/alert_spec.               
                          js.mp4                                                                    


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/alerting-dashboards-plugin/alerts_dashboard_flyout_spec.js             (4 of 45)


  Alerts by trigger flyout
    ✓ Bucket-level monitor flyout test (75124ms)
    ✓ Query-level monitor flyout test (7860ms)


  2 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 23 seconds                                                             │
  │ Spec Ran:     plugins/alerting-dashboards-plugin/alerts_dashboard_flyout_spec.js               │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (5 seconds)
                          press/videos/plugins/alerting-dashboards-plugin/alerts_dash               
                          board_flyout_spec.js.mp4                                                  


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/alerting-dashboards-plugin/bucket_level_monitor_spec.js                (5 of 45)


  Bucket-Level Monitors
    can be created
      ✓ by extraction query (31705ms)
      ✓ by visual editor (27164ms)
    can be updated
      when defined by visual editor
        ✓ by adding trigger (15023ms)


  3 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 14 seconds                                                             │
  │ Spec Ran:     plugins/alerting-dashboards-plugin/bucket_level_monitor_spec.js                  │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (4 seconds)
                          press/videos/plugins/alerting-dashboards-plugin/bucket_leve               
                          l_monitor_spec.js.mp4                                                     


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/alerting-dashboards-plugin/cluster_metrics_monitor_spec.js             (6 of 45)


  ClusterMetricsMonitor
    can be created
      ✓ for the Cluster Health API (23754ms)
      ✓ for the Nodes Stats API (19904ms)
    displays Query parameters field appropriately
      ✓ for the CAT Snapshots API (7321ms)
    clearTriggersModal renders and behaves as expected
      ✓ when no triggers exist (5503ms)
      ✓ when triggers exist (9222ms)
    can update
      Cluster Health API monitor
        ✓ with a new trigger (11517ms)


  6 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        6                                                                                │
  │ Passing:      6                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 17 seconds                                                             │
  │ Spec Ran:     plugins/alerting-dashboards-plugin/cluster_metrics_monitor_spec.js               │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (5 seconds)
                          press/videos/plugins/alerting-dashboards-plugin/cluster_met               
                          rics_monitor_spec.js.mp4                                                  


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/alerting-dashboards-plugin/query_level_monitor_spec.js                 (7 of 45)


  Query-Level Monitors
    can be created
      ✓ by extraction query (12421ms)
    can be updated
      ✓ by changing the name (7160ms)
    can be deleted
      ✓ from "Actions" menu
    can be searched
      ✓ by name
    can have triggers
      ✓ with names that contain periods (54941ms)
    schedule component displays as intended
      ✓ for an interval schedule (7197ms)
      ✓ for a cron expression schedule (5583ms)


  7 passing (2m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        7                                                                                │
  │ Passing:      7                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 36 seconds                                                             │
  │ Spec Ran:     plugins/alerting-dashboards-plugin/query_level_monitor_spec.js                   │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (6 seconds)
                          press/videos/plugins/alerting-dashboards-plugin/query_level               
                          _monitor_spec.js.mp4                                                      


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/anomaly-detection-dashboards-plugin/create_detector_spec.js            (8 of 45)


  Create detector workflow
    ✓ Full creation - based on real index (16999ms)


  1 passing (17s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     17 seconds                                                                       │
  │ Spec Ran:     plugins/anomaly-detection-dashboards-plugin/create_detector_spec.js              │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy     (1 second)
                          press/videos/plugins/anomaly-detection-dashboards-plugin/cr               
                          eate_detector_spec.js.mp4                                                 


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/anomaly-detection-dashboards-plugin/dashboard_spec.js                  (9 of 45)


  AD Dashboard page
    ✓ Empty - no detector index
    ✓ Empty - empty detector index
    ✓ Non-empty - single running detector
    ✓ Redirect to create detector page
    ✓ Filter by detector
    ✓ Filter by detector state
    ✓ Filter by index
    ✓ Enter and exit full screen


  8 passing (21s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        8                                                                                │
  │ Passing:      8                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     21 seconds                                                                       │
  │ Spec Ran:     plugins/anomaly-detection-dashboards-plugin/dashboard_spec.js                    │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy     (1 second)
                          press/videos/plugins/anomaly-detection-dashboards-plugin/da               
                          shboard_spec.js.mp4                                                       


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/anomaly-detection-dashboards-plugin/detector_configuration_s          (10 of 45)
            pec.js                                                                                  


  Detector configuration page
    ✓ Redirect to edit detector settings from button (7872ms)
    ✓ Redirect to edit model configuration from button
    ✓ Redirect to edit detector settings from dropdown
    ✓ Redirect to edit model configuration from dropdown
    ✓ Delete detector from dropdown, redirects to detector list page


  5 passing (10s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        5                                                                                │
  │ Passing:      5                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     9 seconds                                                                        │
  │ Spec Ran:     plugins/anomaly-detection-dashboards-plugin/detector_configuration_spec.js       │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/anomaly-detection-dashboards-plugin/de               
                          tector_configuration_spec.js.mp4                                          


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/anomaly-detection-dashboards-plugin/detector_list_spec.js             (11 of 45)


  Detector list page
    ✓ Empty - no detector index
    ✓ Empty - empty detector index
    ✓ Non-empty - single stopped detector
    ✓ Non-empty - multiple detectors
    ✓ Redirect to create detector
    ✓ Start single detector
    ✓ Stop single detector
    ✓ Delete single detector
    ✓ Filter by detector search
    ✓ Filter by detector state
    ✓ Filter by index


  11 passing (23s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        11                                                                               │
  │ Passing:      11                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     22 seconds                                                                       │
  │ Spec Ran:     plugins/anomaly-detection-dashboards-plugin/detector_list_spec.js                │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy     (1 second)
                          press/videos/plugins/anomaly-detection-dashboards-plugin/de               
                          tector_list_spec.js.mp4                                                   


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/anomaly-detection-dashboards-plugin/historical_analysis_spec          (12 of 45)
            .js                                                                                     


  Historical results page
    Sample detector
      ✓ Empty message with modal (7097ms)
      ✓ Start first historical analysis
      ✓ Produces anomaly results by default (15558ms)
      ✓ Filtering by date range (11849ms)
      1) Aggregations render anomalies
      ✓ Run subsequent historical analysis (16052ms)


  5 passing (2m)
  1 failing

  1) Historical results page
       Sample detector
         Aggregations render anomalies:
     CypressError: Timed out retrying after 60050ms: `cy.click()` failed because this element:

`<label class="euiButtonGroupButton euiButtonGroupButton--text euiButtonGroupButton--small" for="i92b7b861-1908-11ed-a7e5-b1792f060f66">...</label>`

is being covered by another element:

`<select class="euiSelect euiSelect--compressed" aria-label="Time unit" aria-describedby="ia36e48e1-1908-11ed-a7e5-b1792f060f66 ia36e48e2-1908-11ed-a7e5-b1792f060f66">...</select>`

Fix this problem, or use {force: true} to disable error checking.

https://on.cypress.io/element-cannot-be-interacted-with
      at $Cy.ensureDescendents (http://localhost:5601/__cypress/runner/cypress_runner.js:164076:78)
      at ensureDescendents (http://localhost:5601/__cypress/runner/cypress_runner.js:150263:8)
      at ensureDescendentsAndScroll (http://localhost:5601/__cypress/runner/cypress_runner.js:150270:14)
      at ensureElIsNotCovered (http://localhost:5601/__cypress/runner/cypress_runner.js:150402:5)
      at runAllChecks (http://localhost:5601/__cypress/runner/cypress_runner.js:150592:52)
      at retryActionability (http://localhost:5601/__cypress/runner/cypress_runner.js:150616:16)
      at tryCatcher (http://localhost:5601/__cypress/runner/cypress_runner.js:13022:23)
      at Function.Promise.attempt.Promise.try (http://localhost:5601/__cypress/runner/cypress_runner.js:10296:29)
      at whenStable (http://localhost:5601/__cypress/runner/cypress_runner.js:168808:63)
      at http://localhost:5601/__cypress/runner/cypress_runner.js:168305:14
      at tryCatcher (http://localhost:5601/__cypress/runner/cypress_runner.js:13022:23)
      at Promise._settlePromiseFromHandler (http://localhost:5601/__cypress/runner/cypress_runner.js:10957:31)
      at Promise._settlePromise (http://localhost:5601/__cypress/runner/cypress_runner.js:11014:18)
      at Promise._settlePromise0 (http://localhost:5601/__cypress/runner/cypress_runner.js:11059:10)
      at Promise._settlePromises (http://localhost:5601/__cypress/runner/cypress_runner.js:11139:18)
      at Promise._fulfill (http://localhost:5601/__cypress/runner/cypress_runner.js:11083:18)
  From Your Spec Code:
      at Context.eval (http://localhost:5601/__cypress/tests?p=cypress/integration/plugins/anomaly-detection-dashboards-plugin/historical_analysis_spec.js:230:32)




  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        6                                                                                │
  │ Passing:      5                                                                                │
  │ Failing:      1                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  1                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 55 seconds                                                             │
  │ Spec Ran:     plugins/anomaly-detection-dashboards-plugin/historical_analysis_spec.js          │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Screenshots)

  -  /home/ubuntu/repos/opensearch-dashboards-functional-test/cypress/screenshots/plu     (1280x720)
     gins/anomaly-detection-dashboards-plugin/historical_analysis_spec.js/Historical                
     results page -- Sample detector -- Aggregations render anomalies (failed).png                  


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (7 seconds)
                          press/videos/plugins/anomaly-detection-dashboards-plugin/hi               
                          storical_analysis_spec.js.mp4                                             


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/anomaly-detection-dashboards-plugin/overview_spec.js                  (13 of 45)


  Overview page
    ✓ Side nav AD button redirects to overview page
    Flyouts open and close
      ✓ HTTP responses sample detector
      ✓ eCommerce sample detector
      ✓ Host health sample detector


  4 passing (9s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     9 seconds                                                                        │
  │ Spec Ran:     plugins/anomaly-detection-dashboards-plugin/overview_spec.js                     │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/anomaly-detection-dashboards-plugin/ov               
                          erview_spec.js.mp4                                                        


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/anomaly-detection-dashboards-plugin/real_time_results_spec.j          (14 of 45)
            s                                                                                       


  Real-time results page
    Sample detector
      ✓ Renders no anomalies (7384ms)
      ✓ Enter and exit full screen


  2 passing (10s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     9 seconds                                                                        │
  │ Spec Ran:     plugins/anomaly-detection-dashboards-plugin/real_time_results_spec.js            │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/anomaly-detection-dashboards-plugin/re               
                          al_time_results_spec.js.mp4                                               


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/anomaly-detection-dashboards-plugin/sample_detector_spec.js           (15 of 45)


  Sample detectors
    ✓ HTTP response sample detector - create and delete (7254ms)
    ✓ eCommerce sample detector - create and delete
    ✓ Host health sample detector - create and delete


  3 passing (16s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     15 seconds                                                                       │
  │ Spec Ran:     plugins/anomaly-detection-dashboards-plugin/sample_detector_spec.js              │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy     (1 second)
                          press/videos/plugins/anomaly-detection-dashboards-plugin/sa               
                          mple_detector_spec.js.mp4                                                 


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/custom-import-map-dashboards/import_vector_map_tab.spec.js            (16 of 45)


  Verify the presence of import custom map tab in region map plugin
    ✓ checks import custom map tab is present (20994ms)


  1 passing (23s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     23 seconds                                                                       │
  │ Spec Ran:     plugins/custom-import-map-dashboards/import_vector_map_tab.spec.js               │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy     (1 second)
                          press/videos/plugins/custom-import-map-dashboards/import_ve               
                          ctor_map_tab.spec.js.mp4                                                  


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/gantt-chart-dashboards/gantt_ui.spec.js                               (17 of 45)


  Dump test data
    ✓ Indexes test data for gantt chart

  Save a gantt chart
    ✓ Creates and saves a gantt chart (11338ms)

  Render and configure a gantt chart
    ✓ Renders no data message (5068ms)
    ✓ Renders the chart (5227ms)

  Configure panel settings
    ✓ Changes y-axis label (5540ms)
    ✓ Changes x-axis label (5704ms)
    ✓ Changes time formats (9378ms)
    ✓ Hides legends (5273ms)

  Add gantt chart to dashboard
    ✓ Adds gantt chart to dashboard


  9 passing (52s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        9                                                                                │
  │ Passing:      9                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     51 seconds                                                                       │
  │ Spec Ran:     plugins/gantt-chart-dashboards/gantt_ui.spec.js                                  │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (3 seconds)
                          press/videos/plugins/gantt-chart-dashboards/gantt_ui.spec.j               
                          s.mp4                                                                     


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/index-management-dashboards-plugin/indices_spec.js                    (18 of 45)


  Indices
    can be searched
      ✓ successfully (8072ms)
    can show data stream indices
      ✓ successfully (8617ms)
    can have policies applied
      ✓ successfully (9994ms)


  3 passing (27s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     26 seconds                                                                       │
  │ Spec Ran:     plugins/index-management-dashboards-plugin/indices_spec.js                       │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy     (1 second)
                          press/videos/plugins/index-management-dashboards-plugin/ind               
                          ices_spec.js.mp4                                                          


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/index-management-dashboards-plugin/managed_indices_spec.js            (19 of 45)


  Managed indices
    can have policies removed
      ✓ successfully (13834ms)
    can have policies retried
      ✓ successfully (31596ms)
    can edit rollover_alias
      ✓ successfully (5688ms)
    can change policies
      ✓ successfully (17134ms)
    can manage data stream indices
      ✓ successfully (8061ms)


  5 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        5                                                                                │
  │ Passing:      5                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 16 seconds                                                             │
  │ Spec Ran:     plugins/index-management-dashboards-plugin/managed_indices_spec.js               │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (4 seconds)
                          press/videos/plugins/index-management-dashboards-plugin/man               
                          aged_indices_spec.js.mp4                                                  


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/index-management-dashboards-plugin/policies_spec.js                   (20 of 45)


  Policies
    can be created
      ✓ successfully (10779ms)
    can be edited
      ✓ successfully (9187ms)
    can be deleted
      ✓ successfully (5137ms)
    can be searched
      ✓ successfully
    can be viewed
      ✓ successfully


  5 passing (33s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        5                                                                                │
  │ Passing:      5                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     33 seconds                                                                       │
  │ Spec Ran:     plugins/index-management-dashboards-plugin/policies_spec.js                      │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (2 seconds)
                          press/videos/plugins/index-management-dashboards-plugin/pol               
                          icies_spec.js.mp4                                                         


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/index-management-dashboards-plugin/rollups_spec.js                    (21 of 45)


  Rollups
    can be created
      ✓ successfully (18105ms)
    can be edited
      ✓ successfully (9682ms)
    can be deleted
      ✓ successfully (9116ms)
    can be enabled and disabled
      ✓ successfully (8836ms)


  4 passing (46s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     45 seconds                                                                       │
  │ Spec Ran:     plugins/index-management-dashboards-plugin/rollups_spec.js                       │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (3 seconds)
                          press/videos/plugins/index-management-dashboards-plugin/rol               
                          lups_spec.js.mp4                                                          


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/index-management-dashboards-plugin/transforms_spec.js                 (22 of 45)


  Transforms
    can be created
      ✓ successfully (13519ms)
    can be edited
      ✓ successfully (5985ms)
    can be deleted
      ✓ successfully (5649ms)
    can be enabled and disabled
      ✓ successfully (6860ms)


  4 passing (32s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     32 seconds                                                                       │
  │ Spec Ran:     plugins/index-management-dashboards-plugin/transforms_spec.js                    │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (2 seconds)
                          press/videos/plugins/index-management-dashboards-plugin/tra               
                          nsforms_spec.js.mp4                                                       


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/notifications-dashboards/1_email_senders_and_groups.spec.js           (23 of 45)


  Test create email senders
    ✓ creates ssl sender (5281ms)
    ✓ creates tls sender (8498ms)
    ✓ creates SES sender (5362ms)

  Test edit senders
    ✓ edits sender email address (5039ms)
    ✓ edits ses sender region

  Test delete senders
    ✓ deletes smtp senders
    ✓ deletes ses senders (6264ms)

  Test create, edit and delete recipient group
    ✓ creates recipient group (9738ms)
    ✓ edits recipient group description
    ✓ opens email addresses popup
    ✓ deletes recipient groups (6126ms)


  11 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        11                                                                               │
  │ Passing:      11                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 4 seconds                                                              │
  │ Spec Ran:     plugins/notifications-dashboards/1_email_senders_and_groups.spec.js              │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (4 seconds)
                          press/videos/plugins/notifications-dashboards/1_email_sende               
                          rs_and_groups.spec.js.mp4                                                 


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/notifications-dashboards/2_channels.spec.js                           (24 of 45)


  Test create channels
    ✓ creates a slack channel and send test message (7008ms)
    ✓ creates a chime channel (7493ms)
    ✓ creates a email channel (9780ms)
    ✓ creates a email channel with ses sender (10994ms)
    ✓ creates a webhook channel (8148ms)
    ✓ creates a sns channel (7529ms)

  Test channels table
    ✓ displays channels
    ✓ mutes channels (7084ms)
    ✓ filters channels (6769ms)

  Test channel details
    ✓ displays channel details
    ✓ mutes and unmutes channels
    ✓ edits channels (5186ms)
    ✓ deletes channels (5028ms)


  13 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        13                                                                               │
  │ Passing:      13                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 26 seconds                                                             │
  │ Spec Ran:     plugins/notifications-dashboards/2_channels.spec.js                              │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (5 seconds)
                          press/videos/plugins/notifications-dashboards/2_channels.sp               
                          ec.js.mp4                                                                 


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/observability-dashboards/0_before.spec.js                             (25 of 45)


  Before
    ✓ setup completed (8752ms)


  1 passing (9s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     8 seconds                                                                        │
  │ Spec Ran:     plugins/observability-dashboards/0_before.spec.js                                │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/observability-dashboards/0_before.spec               
                          .js.mp4                                                                   


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/observability-dashboards/1_trace_analytics_dashboard.spec.js          (26 of 45)


  Testing dashboard table empty state
    ✓ Renders empty state (5166ms)

  Testing dashboard table
    ✓ Renders the dashboard table (6897ms)
    ✓ Has working breadcrumbs (11280ms)
    ✓ Adds the percentile filters (14545ms)
    ✓ Opens latency trend popover (16391ms)
    ✓ Redirects to traces table with filter (11873ms)

  Testing plots
    ✓ Renders service map (7615ms)
    ✓ Renders plots (5697ms)


  8 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        8                                                                                │
  │ Passing:      8                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 19 seconds                                                             │
  │ Spec Ran:     plugins/observability-dashboards/1_trace_analytics_dashboard.spec.js             │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (5 seconds)
                          press/videos/plugins/observability-dashboards/1_trace_analy               
                          tics_dashboard.spec.js.mp4                                                


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/observability-dashboards/2_trace_analytics_services.spec.js           (27 of 45)


  Testing services table empty state
    ✓ Renders empty state (5169ms)

  Testing services table
    ✓ Renders the services table (6647ms)
    ✓ Searches correctly (9292ms)

  Testing service view empty state
    ✓ Renders service view empty state

  Testing service view
    ✓ Renders service view (5743ms)
    ✓ Has working breadcrumbs (11488ms)
    ✓ Renders spans data grid, flyout, filters (9069ms)


  7 passing (50s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        7                                                                                │
  │ Passing:      7                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     49 seconds                                                                       │
  │ Spec Ran:     plugins/observability-dashboards/2_trace_analytics_services.spec.js              │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (3 seconds)
                          press/videos/plugins/observability-dashboards/2_trace_analy               
                          tics_services.spec.js.mp4                                                 


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/observability-dashboards/3_trace_analytics_traces.spec.js             (28 of 45)


  Testing traces table empty state
    ✓ Renders empty state (5164ms)

  Testing traces table
    ✓ Renders the traces table (6994ms)
    ✓ Sorts the traces table (5123ms)
    ✓ Searches correctly (6252ms)

  Testing trace view
    ✓ Renders the trace view
    ✓ Has working breadcrumbs (8574ms)
    ✓ Renders data grid, flyout and filters (8092ms)


  7 passing (45s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        7                                                                                │
  │ Passing:      7                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     44 seconds                                                                       │
  │ Spec Ran:     plugins/observability-dashboards/3_trace_analytics_traces.spec.js                │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (3 seconds)
                          press/videos/plugins/observability-dashboards/3_trace_analy               
                          tics_traces.spec.js.mp4                                                   


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/observability-dashboards/4_panels.spec.js                             (29 of 45)


  Creating visualizations
    ✓ Create first visualization in event analytics (12623ms)
    ✓ Create second visualization in event analytics (11817ms)

  Testing panels table
    ✓ Displays error toast for invalid panel name
    ✓ Creates a panel and redirects to the panel
    ✓ Duplicates and renames a panel
    ✓ Searches existing panel
    ✓ Deletes panels

  Testing a panel
    ✓ Move to test panel
    ✓ Opens visualization flyout from empty panel
    ✓ Redirects to correct page on breadcrumb click
    ✓ Duplicate the open panel
    ✓ Rename the open panel
    ✓ Change date filter of the panel
    ✓ Add existing visualization #1 (9035ms)
    ✓ Add existing visualization #2
    ✓ Add ppl filter to panel (36803ms)
    ✓ Drag and drop a visualization
    ✓ Resize a visualization
    ✓ Delete a visualization
    ✓ Duplicate a visualization
    ✓ Replace a visualization
    ✓ Create new visualization and add to panel (16095ms)
    ✓ Move to test panel and check visualization edit button (13219ms)

  Clean up all test data
    ✓ Delete visualizations from event analytics
    ✓ Deletes test panel


  25 passing (2m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        25                                                                               │
  │ Passing:      25                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     2 minutes, 26 seconds                                                            │
  │ Spec Ran:     plugins/observability-dashboards/4_panels.spec.js                                │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (9 seconds)
                          press/videos/plugins/observability-dashboards/4_panels.spec               
                          .js.mp4                                                                   


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/observability-dashboards/5_event_analytics.spec.js                    (30 of 45)


  Has working breadcrumbs
    ✓ Redirect to correct page on breadcrumb click (12506ms)

  Search a query on event home
    ✓ Search a query and redirect to explorer to display query output

  Open flyout for a data row to see details
    ✓ Should be able to open flyout and see data, json and traces (7827ms)
    ✓ Should be able to see srrounding docs (7224ms)

  Add/delete/switch explorer top level tabs
    ✓ Add a new tab
    ✓ Click to switch to anther tab
    ✓ Close a tab
    ✓ Close current selected tab
    ✓ Close another unselected tab

  Load a saved query from event home
    ✓ Click on a saved query and redirect to explorer (13380ms)

  Click actions
    ✓ Actions - click event explorer
    ✓ Actions - add sample data (7946ms)
    ✓ Actions - delete saved queries

  Saves a query on explorer page
    ✓ Saves a query on event tab of explorer page (14348ms)
    ✓ Saves a visualization on visualization tab of explorer page (15932ms)
    ✓ Saves a visualization to an existing panel (18154ms)

  Override timestamp for an index
    ✓ Click override button to override default timestamp

  Toggle sidebar fields
    ✓ Toggle fields between available and selected section (6949ms)

  Search fields in sidebar
    ✓ Search a field (6457ms)

  Delete saved objects
    ✓ Delete visualizations/querys from event analytics (13442ms)

  Click to view field insights
    ✓ Click a numerical field to view field insights (5249ms)
    ✓ Click a non-numerical field to view insights (5216ms)

  Switch on and off livetail
    ✓ Switch on and off in live tail (11033ms)

  Live tail stop automatically
    ✓ Moving to other tab should stop live tail automatically (7656ms)
    ✓ Add a new tab
    ✓ Click to switch to another tab
    ✓ Close current selected tab
    ✓ Live tail should be stopped

  Renders noresult chart
    ✓ It should render no result when there is no data

  Renders bar charts
    ✓ Renders vertical bar chart (22622ms)
    ✓ Renders horiztontal bar chart (24924ms)

  Renders line charts
    ✓ Renders line chart with threshold (15404ms)

  Renders pie charts
    ✓ Renders pie chart (8975ms)

  Renders heatmap chart
    ✓ Renders heatmap chart with different z-axes (20967ms)

  Renders markdown chart
    ✓ Renders markdown chart with test title (14854ms)

  Renders data view
    ✓ Switch views between data table and visualization workspace (7322ms)


  36 passing (5m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        36                                                                               │
  │ Passing:      36                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     5 minutes, 6 seconds                                                             │
  │ Spec Ran:     plugins/observability-dashboards/5_event_analytics.spec.js                       │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
    Compression progress:  54%
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy   (18 seconds)
                          press/videos/plugins/observability-dashboards/5_event_analy               
                          tics.spec.js.mp4                                                          


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/observability-dashboards/6_notebooks.spec.js                          (31 of 45)


  Adding sample visualization
    ✓ Add sample observability data (6035ms)

  Testing notebooks table
    ✓ Displays error toast for invalid notebook name (5295ms)
    ✓ Creates a notebook and redirects to the notebook
    ✓ Duplicates and renames a notebook (16137ms)
    ✓ Searches existing notebooks (7549ms)
    ✓ Deletes notebooks (11858ms)

  Test reporting integration if plugin installed
    ✓ Create in-context PDF report from notebook (8018ms)
    ✓ Create in-context PNG report from notebook (8134ms)
    ✓ Create on-demand report definition from context menu (11651ms)
    ✓ View reports homepage from context menu (9189ms)

  Testing paragraphs
    ✓ Goes into a notebook and creates paragraphs (13563ms)
    ✓ Has working breadcrumbs (7060ms)
    ✓ Renders markdown
    ✓ Shows output message (6572ms)
    ✓ Renders input only mode
    ✓ Renders output only mode
    ✓ Duplicates paragraphs (6460ms)
    ✓ Adds a dashboards visualization paragraph (14634ms)
    ✓ Adds a SQL query paragraph (15884ms)
    ✓ Adds an observability visualization paragraph (16867ms)
    ✓ Adds a PPL query paragraph (18005ms)
    ✓ Clears outputs (12289ms)
    ✓ Runs all paragraphs (9709ms)
    ✓ Adds paragraph to top and bottom (18086ms)
    ✓ Moves paragraphs (6902ms)
    ✓ Duplicates and renames the notebook (21795ms)
    ✓ Deletes paragraphs (11319ms)
    ✓ Deletes notebook (10281ms)
    ✓ Cleans up test notebooks (10282ms)

  clean up all test data
    ✓ Delete visualizations from event analytics (12415ms)
    ✓ Deletes test panel (10092ms)


  31 passing (5m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        31                                                                               │
  │ Passing:      31                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     5 minutes, 20 seconds                                                            │
  │ Spec Ran:     plugins/observability-dashboards/6_notebooks.spec.js                             │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
    Compression progress:  52%
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy   (19 seconds)
                          press/videos/plugins/observability-dashboards/6_notebooks.s               
                          pec.js.mp4                                                                


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/observability-dashboards/7_app_analytics.spec.js                      (32 of 45)


  Creating application
    ✓ Creates an application and redirects to application (95278ms)

  Viewing application
    ✓ Saves visualization #1 to panel (134312ms)
    ✓ Adds availability level to visualization #1 (17459ms)
    ✓ Saves visualization #2 to panel with availability level (150235ms)
    ✓ Changes availability visualization (78170ms)

  Editing application
    ✓ Redirects to application after saving changes (64883ms)

  Application Analytics home page
    1) Renames application
    ✓ Deletes application (5712ms)


  7 passing (10m)
  1 failing

  1) Application Analytics home page
       Renames application:
     CypressError: Timed out retrying after 60050ms: `cy.click()` failed because this element is `disabled`:

`<button disabled="" class="euiContextMenuItem euiContextMenuItem-isDisabled" type="button" data-test-subj="renameApplicationContextMenuItem">...</button>`

Fix this problem, or use `{force: true}` to disable error checking.

https://on.cypress.io/element-cannot-be-interacted-with
      at $Cy.ensureNotDisabled (http://localhost:5601/__cypress/runner/cypress_runner.js:163868:76)
      at runAllChecks (http://localhost:5601/__cypress/runner/cypress_runner.js:150539:14)
      at retryActionability (http://localhost:5601/__cypress/runner/cypress_runner.js:150616:16)
      at tryCatcher (http://localhost:5601/__cypress/runner/cypress_runner.js:13022:23)
      at Function.Promise.attempt.Promise.try (http://localhost:5601/__cypress/runner/cypress_runner.js:10296:29)
      at whenStable (http://localhost:5601/__cypress/runner/cypress_runner.js:168808:63)
      at http://localhost:5601/__cypress/runner/cypress_runner.js:168305:14
      at tryCatcher (http://localhost:5601/__cypress/runner/cypress_runner.js:13022:23)
      at Promise._settlePromiseFromHandler (http://localhost:5601/__cypress/runner/cypress_runner.js:10957:31)
      at Promise._settlePromise (http://localhost:5601/__cypress/runner/cypress_runner.js:11014:18)
      at Promise._settlePromise0 (http://localhost:5601/__cypress/runner/cypress_runner.js:11059:10)
      at Promise._settlePromises (http://localhost:5601/__cypress/runner/cypress_runner.js:11139:18)
      at Promise._fulfill (http://localhost:5601/__cypress/runner/cypress_runner.js:11083:18)
      at http://localhost:5601/__cypress/runner/cypress_runner.js:12697:46
  From Your Spec Code:
      at Context.eval (http://localhost:5601/__cypress/tests?p=cypress/integration/plugins/observability-dashboards/7_app_analytics.spec.js:492:8)




  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        8                                                                                │
  │ Passing:      7                                                                                │
  │ Failing:      1                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  1                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     10 minutes, 11 seconds                                                           │
  │ Spec Ran:     plugins/observability-dashboards/7_app_analytics.spec.js                         │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Screenshots)

  -  /home/ubuntu/repos/opensearch-dashboards-functional-test/cypress/screenshots/plu     (1280x720)
     gins/observability-dashboards/7_app_analytics.spec.js/Application Analytics home               
      page -- Renames application (failed).png                                                      


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
    Compression progress:  27%
    Compression progress:  52%
    Compression progress:  79%
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy   (38 seconds)
                          press/videos/plugins/observability-dashboards/7_app_analyti               
                          cs.spec.js.mp4                                                            


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/observability-dashboards/8_after.spec.js                              (33 of 45)


  After
    ✓ clean up complete


  1 passing (74ms)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        1                                                                                │
  │ Passing:      1                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     0 seconds                                                                        │
  │ Spec Ran:     plugins/observability-dashboards/8_after.spec.js                                 │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/observability-dashboards/8_after.spec.               
                          js.mp4                                                                    


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/query-workbench-dashboards/ui.spec.js                                 (34 of 45)


  Dump test data
    ✓ Indexes test data for SQL and PPL

  Test PPL UI
    ✓ Confirm results are empty
    ✓ Test Run button (5122ms)
    ✓ Test Clear button (6804ms)
    ✓ Test full screen view (5954ms)

  Test SQL UI
    ✓ Confirm results are empty
    ✓ Test Run button and field search (5538ms)
    ✓ Test Translate button (6318ms)
    ✓ Test Clear button
    ✓ Test full screen view

  Test and verify SQL downloads
    ✓ Download and verify JSON
    ✓ Download and verify JDBC
    ✓ Download and verify CSV
    ✓ Download and verify Text

  Test table display
    ✓ Test GROUP BY (6039ms)
    ✓ Test GROUP BY with aliases and scalar function (6175ms)
    ✓ Test GROUP BY and HAVING (6458ms)
    ✓ Test ORDER BY (6273ms)
    ✓ Test JOIN (7264ms)
    ✓ Test nested fields display (7121ms)


  20 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        20                                                                               │
  │ Passing:      20                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 23 seconds                                                             │
  │ Spec Ran:     plugins/query-workbench-dashboards/ui.spec.js                                    │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (5 seconds)
                          press/videos/plugins/query-workbench-dashboards/ui.spec.js.               
                          mp4                                                                       


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/reports-dashboards/01-create.spec.js                                  (35 of 45)


  Cypress
    ✓ Visits Reporting homepage (50726ms)
    ✓ Visit Create page
    ✓ Create a new on-demand dashboard report definition (9414ms)
    ✓ Create a new on-demand visualization report definition (9037ms)
    ✓ Create a new on-demand saved search report definition (9108ms)
    ✓ Create a new dashboard daily recurring report definition (10190ms)
    ✓ Create a new visualization daily recurring report definition (9818ms)
    ✓ Create a new saved search daily recurring report definition (7836ms)
    ✓ Create a new dashboard interval recurring report definition (25228ms)
    ✓ Create a new visualization interval recurring report definition (27437ms)
    ✓ Create a new saved search interval recurring report definition (27660ms)
    ✓ Create a dashboard cron-based report definition (25368ms)
    ✓ Create a visualization cron-based report definition (24582ms)
    ✓ Create a saved search cron-based report definition (25169ms)


  14 passing (4m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        14                                                                               │
  │ Passing:      14                                                                               │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     4 minutes, 26 seconds                                                            │
  │ Spec Ran:     plugins/reports-dashboards/01-create.spec.js                                     │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
    Compression progress:  64%
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy   (17 seconds)
                          press/videos/plugins/reports-dashboards/01-create.spec.js.m               
                          p4                                                                        


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/reports-dashboards/02-edit.spec.js                                    (36 of 45)


  Cypress
    ✓ Visit edit page, update name and description (31247ms)
    ✓ Visit edit page, change report trigger (26735ms)
    ✓ Visit edit page, change report trigger back (26693ms)


  3 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        3                                                                                │
  │ Passing:      3                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 24 seconds                                                             │
  │ Spec Ran:     plugins/reports-dashboards/02-edit.spec.js                                       │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (5 seconds)
                          press/videos/plugins/reports-dashboards/02-edit.spec.js.mp4               


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/reports-dashboards/03-details.spec.js                                 (37 of 45)


  Cypress
    ✓ Visit report definition details page (33183ms)
    ✓ Go to edit report definition from report definition details (16716ms)
    ✓ Verify report source URL on report definition details (31264ms)
    ✓ Delete report definition from details page (7227ms)
    ✓ Visit report details page (6407ms)
    ✓ Verify report source URL on report details (31057ms)


  6 passing (2m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        6                                                                                │
  │ Passing:      6                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     2 minutes, 5 seconds                                                             │
  │ Spec Ran:     plugins/reports-dashboards/03-details.spec.js                                    │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (7 seconds)
                          press/videos/plugins/reports-dashboards/03-details.spec.js.               
                          mp4                                                                       


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/reports-dashboards/04-download.spec.js                                (38 of 45)


  Cypress
    ✓ Download from reporting homepage (12957ms)
    ✓ Download pdf from in-context menu (5469ms)
    ✓ Download png from in-context menu (5610ms)
    ✓ Download csv from saved search in-context menu (10567ms)
    ✓ Download from Report definition details page (30467ms)


  5 passing (1m)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        5                                                                                │
  │ Passing:      5                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     1 minute, 16 seconds                                                             │
  │ Spec Ran:     plugins/reports-dashboards/04-download.spec.js                                   │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (4 seconds)
                          press/videos/plugins/reports-dashboards/04-download.spec.js               
                          .mp4                                                                      


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/security/audit_log_spec.js                                            (39 of 45)


  Audit logs page
    ✓ should load Audit logs page properly
    ✓ should toggle enable-disable switch for audit logging
    ✓ should configure general settings successfully
    ✓ should configure compliance settings successfully


  4 passing (9s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     9 seconds                                                                        │
  │ Spec Ran:     plugins/security/audit_log_spec.js                                               │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/security/audit_log_spec.js.mp4                       


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/security/auth_spec.js                                                 (40 of 45)


  Authc and Authz page
    ✓ authentication and authorization section should exist
    ✓ View Expression Modal should display and close correctly


  2 passing (6s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     5 seconds                                                                        │
  │ Spec Ran:     plugins/security/auth_spec.js                                                    │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/security/auth_spec.js.mp4                            


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/security/get_started_spec.js                                          (41 of 45)


  Home(Get Started) page
    ✓ should load Home page properly
    ✓ should redirect to Auth page
    ✓ should redirect to view Roles page
    ✓ should redirect to create Roles page
    ✓ should redirect to view Users page
    ✓ should redirect to create Users page
    ✓ should redirect to Audit Logging page
    ✓ should purge Cache successfully


  8 passing (11s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        8                                                                                │
  │ Passing:      8                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     11 seconds                                                                       │
  │ Spec Ran:     plugins/security/get_started_spec.js                                             │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/security/get_started_spec.js.mp4                     


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/security/internalusers_spec.js                                        (42 of 45)


  Internal users page
    ✓ should load internal users page properly
    ✓ should view user edit page when a user is clicked
    ✓ should redirect to create new users page
    ✓ should create new user successfully


  4 passing (10s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     10 seconds                                                                       │
  │ Spec Ran:     plugins/security/internalusers_spec.js                                           │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/security/internalusers_spec.js.mp4                   


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/security/permissions_spec.js                                          (43 of 45)


  Permissions page
    ✓ should load Permissions page properly
    ✓ should expand an action-group when it is clicked
    ✓ should open modal with options to create new action group page
    ✓ should create new action group successfully by selecting `Create from blank`
    ✓ should create new action group successfully by selecting `Create from selection` (5371ms)


  5 passing (16s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        5                                                                                │
  │ Passing:      5                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     15 seconds                                                                       │
  │ Spec Ran:     plugins/security/permissions_spec.js                                             │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy     (1 second)
                          press/videos/plugins/security/permissions_spec.js.mp4                     


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/security/roles_spec.js                                                (44 of 45)


  Roles page
    ✓ should load Roles page properly
    ✓ should open Cluster Permissions drop-down menu when clicked
    ✓ should redirect to create new role page
    ✓ should create new role successfully


  4 passing (10s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        4                                                                                │
  │ Passing:      4                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     9 seconds                                                                        │
  │ Spec Ran:     plugins/security/roles_spec.js                                                   │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/security/roles_spec.js.mp4                           


────────────────────────────────────────────────────────────────────────────────────────────────────
                                                                                                    
  Running:  plugins/security/tenants_spec.js                                              (45 of 45)


  Tenants page
    ✓ should load Tenants page properly
    ✓ should create new tenant successfully by selecting `Create tenant`


  2 passing (8s)


  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        2                                                                                │
  │ Passing:      2                                                                                │
  │ Failing:      0                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  0                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     8 seconds                                                                        │
  │ Spec Ran:     plugins/security/tenants_spec.js                                                 │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘


  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
  -  Finished processing: /home/ubuntu/repos/opensearch-dashboards-functional-test/cy    (0 seconds)
                          press/videos/plugins/security/tenants_spec.js.mp4                         


====================================================================================================

  (Run Finished)


       Spec                                              Tests  Passing  Failing  Pending  Skipped  
  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ ✔  core-opensearch-dashboards/opensear      00:28       34       34        -        -        - │
  │    ch-dashboards/dashboard_sanity_test                                                         │
  │    _spec.js                                                                                    │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      01:21        3        3        -        -        - │
  │    acknowledge_alerts_modal_spec.js                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      02:21        5        5        -        -        - │
  │    alert_spec.js                                                                               │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      01:23        2        2        -        -        - │
  │    alerts_dashboard_flyout_spec.js                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      01:14        3        3        -        -        - │
  │    bucket_level_monitor_spec.js                                                                │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      01:17        6        6        -        -        - │
  │    cluster_metrics_monitor_spec.js                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/alerting-dashboards-plugin/      01:36        7        7        -        -        - │
  │    query_level_monitor_spec.js                                                                 │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:17        1        1        -        -        - │
  │    s-plugin/create_detector_spec.js                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:21        8        8        -        -        - │
  │    s-plugin/dashboard_spec.js                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:09        5        5        -        -        - │
  │    s-plugin/detector_configuration_spe                                                         │
  │    c.js                                                                                        │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:22       11       11        -        -        - │
  │    s-plugin/detector_list_spec.js                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  plugins/anomaly-detection-dashboard      01:55        6        5        1        -        - │
  │    s-plugin/historical_analysis_spec.j                                                         │
  │    s                                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:09        4        4        -        -        - │
  │    s-plugin/overview_spec.js                                                                   │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:09        2        2        -        -        - │
  │    s-plugin/real_time_results_spec.js                                                          │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/anomaly-detection-dashboard      00:15        3        3        -        -        - │
  │    s-plugin/sample_detector_spec.js                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/custom-import-map-dashboard      00:23        1        1        -        -        - │
  │    s/import_vector_map_tab.spec.js                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/gantt-chart-dashboards/gant      00:51        9        9        -        -        - │
  │    t_ui.spec.js                                                                                │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/index-management-dashboards      00:26        3        3        -        -        - │
  │    -plugin/indices_spec.js                                                                     │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/index-management-dashboards      01:16        5        5        -        -        - │
  │    -plugin/managed_indices_spec.js                                                             │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/index-management-dashboards      00:33        5        5        -        -        - │
  │    -plugin/policies_spec.js                                                                    │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/index-management-dashboards      00:45        4        4        -        -        - │
  │    -plugin/rollups_spec.js                                                                     │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/index-management-dashboards      00:32        4        4        -        -        - │
  │    -plugin/transforms_spec.js                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/notifications-dashboards/1_      01:04       11       11        -        -        - │
  │    email_senders_and_groups.spec.js                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/notifications-dashboards/2_      01:26       13       13        -        -        - │
  │    channels.spec.js                                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/0_      00:08        1        1        -        -        - │
  │    before.spec.js                                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/1_      01:19        8        8        -        -        - │
  │    trace_analytics_dashboard.spec.js                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/2_      00:49        7        7        -        -        - │
  │    trace_analytics_services.spec.js                                                            │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/3_      00:44        7        7        -        -        - │
  │    trace_analytics_traces.spec.js                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/4_      02:26       25       25        -        -        - │
  │    panels.spec.js                                                                              │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/5_      05:06       36       36        -        -        - │
  │    event_analytics.spec.js                                                                     │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/6_      05:20       31       31        -        -        - │
  │    notebooks.spec.js                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✖  plugins/observability-dashboards/7_      10:11        8        7        1        -        - │
  │    app_analytics.spec.js                                                                       │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/observability-dashboards/8_       76ms        1        1        -        -        - │
  │    after.spec.js                                                                               │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/query-workbench-dashboards/      01:23       20       20        -        -        - │
  │    ui.spec.js                                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/reports-dashboards/01-creat      04:26       14       14        -        -        - │
  │    e.spec.js                                                                                   │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/reports-dashboards/02-edit.      01:24        3        3        -        -        - │
  │    spec.js                                                                                     │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/reports-dashboards/03-detai      02:05        6        6        -        -        - │
  │    ls.spec.js                                                                                  │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/reports-dashboards/04-downl      01:16        5        5        -        -        - │
  │    oad.spec.js                                                                                 │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/audit_log_spec.js       00:09        4        4        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/auth_spec.js            00:05        2        2        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/get_started_spec.j      00:11        8        8        -        -        - │
  │    s                                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/internalusers_spec      00:10        4        4        -        -        - │
  │    .js                                                                                         │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/permissions_spec.j      00:15        5        5        -        -        - │
  │    s                                                                                           │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/roles_spec.js           00:09        4        4        -        -        - │
  ├────────────────────────────────────────────────────────────────────────────────────────────────┤
  │ ✔  plugins/security/tenants_spec.js         00:08        2        2        -        -        - │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘
    ✖  2 of 45 failed (4%)                      58:39      356      354        2        -        -  

info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.

@kotwanikunal
Copy link
Member

Performance Test re-run results -

The previous arm64 without security seemed to be an outlier which was rectified by the re-run.

Product/ Version Architecture Description Instance Type Workload Details Index Latency (ms) p50 Index Latency (ms) p90 Index Latency (ms) p99 Index Latency (ms) p100 Index Throughput (docs/s) p0 Index Throughput (docs/s) p50 Index Throughput (docs/s) p100 Index Throughput (docs/s) Ops Count Index Operation Counts Op Error Count Index Operation Counts Error Rate Query Latency (ms) p50 Query Latency (ms) p90 Query Latency (ms) p99 Query Latency (ms) p100 Query Throughput (docs/s) p0 Query Throughput (docs/s) p50 Query Throughput (docs/s) p100 Query Operation Counts Ops Count Query Operation Counts Op Error Count Error Rate****Query** Operation Counts** CPU (%) p50 CPU (%) p90 CPU (%) p99 CPU (%) p100 Memory (%) p50 Memory (%) p90 Memory (%) p99 Memory (%) p100 GC (ms) Old GC (ms) Young
OpenSearch - 2.1.0 X64 With Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 2,324.80 3,073.90 6,064.20 10,016.10 31,888.40 33,275.90 37,798.70 46,905 0 0 289.6 303.7 313.7 330.4 1.73 1.741 1.754 1,510 0 0 97 97 97 98 51.333 65 82.61 92 0 1,245,816
OpenSearch - 2.1.0 X64 Without Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 2,193.60 2,908.70 5,561.70 8,586 33,935.30 35,489.10 40,399.60 46,728 0 0 279.8 288.1 301.2 309.8 1.727 1.742 1.756 1,510 0 0 97 98 98 98 49 62 86.36 94 0 1,041,064
OpenSearch - 2.1.0 ARM64 With Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 1,916 2,524.20 4,626.10 6,358.80 38,446.80 40,096.30 43,909.90 46,468 0 0 363.8 372.5 379.1 385.6 1.686 1.707 1.754 1,510 0 0 96 97 97 97 50.333 65 81 90 0 917,896
OpenSearch - 2.1.0 ARM64 Without Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 1,668.20 2,223.30 4,057.60 6,691.20 44,384.30 46,221.20 50,871 45,960 0 0 351.9 361.3 366.5 368.3 1.709 1.732 1.755 1,510 0 0 96 97 97 97 47 63 82.58 93 0 822,345
OpenSearch - 2.2.0 X64 With Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 2,211.27 2,890.46 5,633.01 8,836.61 33,197.68 35,075.64 39,594.34 46,783 0 0 282.267 288.9 297.585 309.173 1.727 1.74 1.753 1,510 0 0 97 97 97.532 98 54 88 66 94 0 1,237,246
OpenSearch - 2.2.0 X64 Without Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 2,186.68 2,900.06 5,635.71 9,135.63 33,752.51 35,539.30 40,463.50 46,719 0 0 277.991 284.457 294.579 308.001 1.727 1.742 1.756 1,510 0 0 97 98 98 98 49 87.87 65 92 0 1,048,250
OpenSearch - 2.2.0 ARM64 With Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 1,906.08 2,518.58 4,694.59 6,648.64 38,407.62 39,954.75 43,516.45 46,487 0 0 381.273 393.433 396.973 475.763 1.693 1.716 1.747 1,510 0 0 96 97 97 97 52 81.82 66 90 0 977,237
OpenSearch - 2.2.0 ARM64 Without Security m5.xlarge nyc_taxis/ 2 warmupIterations/ 3 testIterations 1,623.33 2,178.12 4,071.57 5,921.38 44,770.95 46,766.53 51,702.92 45,894 0 0 362.253 372.819 380.157 384.054 1.686 1.71 1.754 1,510 0 0 96 97 97 97 50 85.79 64 91 0 830,052

@bbarani
Copy link
Member

bbarani commented Aug 11, 2022

./opensearch-plugin install repository-s3
warning: ignoring JAVA_TOOL_OPTIONS=-Dlog4j2.formatMsgNoLookups=true
-> Installing repository-s3
-> Downloading repository-s3 from opensearch
[=================================================] 100%   
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@     WARNING: plugin requires additional permissions     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
* java.lang.RuntimePermission accessDeclaredMembers
* java.lang.RuntimePermission getClassLoader
* java.lang.reflect.ReflectPermission suppressAccessChecks
* java.net.NetPermission setDefaultAuthenticator
* java.net.SocketPermission * connect,resolve
* java.util.PropertyPermission opensearch.allow_insecure_settings read,write
See http://docs.oracle.com/javase/8/docs/technotes/guides/security/permissions.html
for descriptions of what these permissions allow and the associated risks.

Continue with installation? [y/N]y
-> Installed repository-s3 with folder name repository-s3

@peterzhuamazon
Copy link
Member

peterzhuamazon commented Aug 11, 2022

RPM YUM verification:

opensearch.x86_64                                                                                                                                          2.0.0-1                                                                                                                                           opensearch-2.x
opensearch.x86_64                                                                                                                                          2.0.1-1                                                                                                                                           opensearch-2.x
opensearch.x86_64                                                                                                                                          2.1.0-1                                                                                                                                           opensearch-2.x
opensearch.x86_64                                                                                                                                          2.2.0-1                                                                                                                                           opensearch-2.x

opensearch-dashboards.x86_64                                                                                                                               2.0.0-1                                                                                                                                opensearch-dashboards-2.x
opensearch-dashboards.x86_64                                                                                                                               2.0.1-1                                                                                                                                opensearch-dashboards-2.x
opensearch-dashboards.x86_64                                                                                                                               2.1.0-1                                                                                                                                opensearch-dashboards-2.x
opensearch-dashboards.x86_64                                                                                                                               2.2.0-1                                                                                                                                opensearch-dashboards-2.x

opensearch.aarch64                                                                                                                                          2.0.0-1                                                                                                                                           opensearch-2.x
opensearch.aarch64                                                                                                                                          2.0.1-1                                                                                                                                           opensearch-2.x
opensearch.aarch64                                                                                                                                          2.1.0-1                                                                                                                                           opensearch-2.x
opensearch.aarch64                                                                                                                                          2.2.0-1                                                                                                                                           opensearch-2.x

opensearch-dashboards.aarch64                                                                                                                               2.0.0-1                                                                                                                                opensearch-dashboards-2.x
opensearch-dashboards.aarch64                                                                                                                               2.0.1-1                                                                                                                                opensearch-dashboards-2.x
opensearch-dashboards.aarch64                                                                                                                               2.1.0-1                                                                                                                                opensearch-dashboards-2.x
opensearch-dashboards.aarch64                                                                                                                               2.2.0-1                                                                                                                                opensearch-dashboards-2.x

@peterzhuamazon
Copy link
Member

peterzhuamazon commented Aug 11, 2022

@vinylen
Copy link

vinylen commented Aug 12, 2022

Hi,

Thanks for the release. Seems that build-tools for 2.2.0 is missing though?
https://repo.gradle.org/ui/native/jcenter/org/opensearch/gradle/build-tools/

@grmblfrz
Copy link

Seems to me that all maven artifacts for 2.2.0 are missing, can't find them anywhere...

@lukas-vlcek
Copy link

lukas-vlcek commented Aug 12, 2022

The plugin artifacts are not available and thus the plugin install command fails as well.

% ./bin/opensearch-plugin install opensearch-sql  --verbose
-> Installing opensearch-sql
-> Failed installing opensearch-sql
-> Rolling back opensearch-sql
-> Rolled back opensearch-sql

BTW, it would be useful to improve the --verbose output in this case because it does not provide any further details about why the installation failed.

@bbarani
Copy link
Member

bbarani commented Aug 12, 2022

@lukas-vlcek OpenSearch currently does not have support to install standalone plugins (outside of native plugins inherited from Elasticsearch) using plugin install command. You can view more details and the workaround in the below thread

https://forum.opensearch.org/t/download-urls-for-plugins-not-listed-anywhere/8297/6?u=bbarani

@gaiksaya
Copy link
Member

We are looking into the maven artifacts. Filed an issue with sonatype to get some information.
Thanks!

@gaiksaya
Copy link
Member

Hey everyone, the artifacts are available on maven now. https://repo1.maven.org/maven2/org/opensearch/opensearch/2.2.0/
please let us know if you see any issues.
Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release v2.2.0 Release 2.2.0
Projects
None yet
Development

No branches or pull requests