Remove default admin credentials #1134
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
jackiehanyang
requested review from
jmazanec15,
jngz-es,
kaituo,
saratvemulapalli,
ohltyler,
vamshin,
VijayanB,
ylwu-amzn,
amitgalitz,
sean-zheng-amazon,
dbwiddis,
owaiskazi19 and
joshpalis
as code owners
opensearch-trigger-bot
bot
added
documentation
This was referenced Jan 23, 2024
| @@ -72,11 +72,11 @@ jobs: | |||
| - name: Run AD Test | |||
| if: env.imagePresent == 'true' | |||
| run: | | |||
| security=`curl -XGET https://localhost:9200/_cat/plugins?v -u admin:admin --insecure |grep opensearch-security|wc -l` | |||
| security=`curl -XGET https://localhost:9200/_cat/plugins?v -u admin:myStrongPassword123! --insecure |grep opensearch-security|wc -l` | |||
There was a problem hiding this comment.
this password needs to be passed to the containers on line 70 with -e OPENSEARCH_INITIAL_ADMIN_PASSWORD=myStrongPassword123!
There is no default password for admin user starting 2.12. This password needs to be set, and you can set it as above.
Also, this change should only be present for branches pointing to 2.12 image.
There was a problem hiding this comment.
Also, this change should only be present for branches pointing to 2.12 image.
Should this change be present for branches pointing to 2.12 image or 2.12 and above image? This change is towards main branch and will be backported to 2.x branch
There was a problem hiding this comment.
The change should be present starting from 2.12. (not in 2.11.1 and below).
This change is towards main branch and will be backported to 2.x branch
yes.
DEVELOPER_GUIDE.md
Outdated
| @@ -42,7 +42,7 @@ Currently we just put RCF jar in lib as dependency. Plan to publish to Maven and | |||
| 2. `./gradlew :run` launches a single node cluster with anomaly-detection (and job-scheduler) plugin installed | |||
| 3. `./gradlew :integTest` launches a single node cluster with anomaly-detection (and job-scheduler) plugin installed and runs all integration tests except security | |||
| 4. ` ./gradlew :integTest --tests="**.test execute foo"` runs a single integration test class or method | |||
| 5. `./gradlew integTestRemote -Dtests.rest.cluster=localhost:9200 -Dtests.cluster=localhost:9200 -Dtests.clustername="docker-cluster" -Dhttps=true -Duser=admin -Dpassword=admin` launches integration tests against a local cluster and run tests with security | |||
| 5. `./gradlew integTestRemote -Dtests.rest.cluster=localhost:9200 -Dtests.cluster=localhost:9200 -Dtests.clustername="docker-cluster" -Dhttps=true -Duser=admin -Dpassword=myStrongPassword123!` launches integration tests against a local cluster and run tests with security | |||
There was a problem hiding this comment.
myStrongPassword123! should not be considered as default password.
admin should be replaced with a placeholder <admin-password>
There was a problem hiding this comment.
Updated with placeholder <admin-password> in the latest revision
DarshitChanpura
suggested changes
Jan 23, 2024
dataGeneration/README.md
Outdated
| @@ -51,7 +51,7 @@ The dataset created will have two categorical fields to test a multi-entity AD ( | |||
| | --number-of-process | number of 'process' entities (process is one of the categorical field that an entity is defined by)| 1000 | No | |||
| | --number-of-historical-days | number of day of historical data to ingest | 2 | No | |||
| | --username | username for authentication if security is true | admin | No | |||
| | --password | password for authentication if security is true | admin | No | |||
| | --password | password for authentication if security is true | myStrongPassword123! | No | |||
There was a problem hiding this comment.
Updated with placeholder <admin-password> in the latest revision
| @@ -42,7 +42,7 @@ | |||
| parser.add_argument("-np", "--number-of-process", type=int, default=1000, help="number of 'process' entities, deafult is set to 1000, there will be two keyword categories in this index (must be at least 1)" ) | |||
| parser.add_argument("-hd", "--number-of-historical-days", type=int, default=2, help="number of day of historical data to ingest, defaults to 2") | |||
| parser.add_argument("-u", "--username", type=str, default="admin", help="username for authentication if security is true") | |||
| parser.add_argument("-pass", "--password", type=str, default="admin", help="password for authentication if security is true") | |||
| parser.add_argument("-pass", "--password", type=str, default="myStrongPassword123!", help="password for authentication if security is true") | |||
There was a problem hiding this comment.
Updated with placeholder <admin-password> in the latest revision in all README files. Leaving it as myStrongPassword123! in this file as it's not a README file
|
Seems the security enabled integration tests are being skipped all together due to the cluster not being available, not due to the security plugin being unavailable (reference run) : @jackiehanyang This is due to issues with the provided docker image, but can you confirm if these changes pass locally? |
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
This is a known issue for AD. The tests were passing locally and there aren't much new changes for AD lately. We should be fine here. Cc @kaituo |
DarshitChanpura
approved these changes
Jan 25, 2024
joshpalis
approved these changes
Jan 25, 2024
ohltyler
approved these changes
Jan 25, 2024
opensearch-trigger-bot bot
pushed a commit
that referenced
this pull request
Jan 25, 2024
* Remove default admin credentials Signed-off-by: Jackie Han <jkhanjob@gmail.com> * Replace default password with a placeholder in README files Signed-off-by: Jackie Han <jkhanjob@gmail.com> --------- Signed-off-by: Jackie Han <jkhanjob@gmail.com> (cherry picked from commit 7192d84) Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
jackiehanyang
pushed a commit
that referenced
this pull request
Jan 25, 2024
* Remove default admin credentials * Replace default password with a placeholder in README files --------- (cherry picked from commit 7192d84) Signed-off-by: Jackie Han <jkhanjob@gmail.com> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
kaituo
added a commit
to kaituo/anomaly-detection-1
that referenced
this pull request
Mar 27, 2024
commit 303ceb5b320f148dcd015ab6a11f870ae3e23125
Author: Joshua Palis <jpalis@amazon.com>
Date: Mon Mar 18 16:49:59 2024 -0700
Adding 2.13 release notes (#1170)
Signed-off-by: Joshua Palis <jpalis@amazon.com>
commit 1507dd4b4045bd8e8cdf505d07041ce304788ca0
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Feb 21 15:59:34 2024 -0800
Inject NamedWriteableRegistry in AD node client (#1164)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 5b85720d442d1b43001dde0c20248fd4a20a64b0
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Tue Feb 13 10:20:20 2024 -0800
Fixed lucene url (#1158)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 290bdcd832a0cae6d039787d9f0af73ea6be2ec2
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Feb 6 16:14:49 2024 -0800
add 2.12 release notes (#1152)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 6a6eec347379c997f0f7acc88b027bc1ffdd8f54
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Tue Jan 30 18:20:36 2024 -0800
Add ser/deser to get AD transport action request (#1150)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 475f0c36e5b6267aaeb101627b9c3ae1fcca3a88
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Thu Jan 25 14:37:12 2024 -0800
Updated lucene snapshot url (#1146)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 7192d848d2923566a409901909f342a63695e1c2
Author: Jackie Han <hnyng@amazon.com>
Date: Thu Jan 25 09:48:37 2024 -0800
Remove default admin credentials (#1134)
* Remove default admin credentials
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Replace default password with a placeholder in README files
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 97482c19b0eded34a7f435e589303a834c258aa3
Author: Jackie Han <hnyng@amazon.com>
Date: Wed Jan 24 09:39:55 2024 -0800
Require JDK version for java spotless check (#1129)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 708e0462189677a217b35905c2feba5486c77cdc
Author: Andriy Redko <andriy.redko@aiven.io>
Date: Tue Jan 23 15:11:39 2024 -0500
Update to Jackson 2.16.1 (#1135)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
commit 7c0ce4cb554a05230ecf5365b903219f357997bf
Author: Andriy Redko <drreta@gmail.com>
Date: Tue Jan 16 17:51:37 2024 -0500
Update to Gradle 8.5 (#1131)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
commit e5cbe93c0e9cadebe2a30cba83f99ae8a3f8fe57
Author: zane-neo <zaniu@amazon.com>
Date: Thu Jan 4 16:50:47 2024 +0800
add publishToMavenLocal task to fix zip plugin not pulished to maven local issue when running this script (#1121)
Signed-off-by: zane-neo <zaniu@amazon.com>
commit 106dc25b3ef36beae329dc7882bcdf9c23347fb5
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Dec 27 16:33:25 2023 -0800
Refactor client's getDetectorProfile to use GetAnomalyDetectorTransportAction (#1124)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 59b4ebecfa11cac977f49c999ce85637fb6fac58
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Dec 27 11:56:00 2023 -0800
Add profile transport action to AD client (#1119)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 29711f96dbb2c9abc1181b933a8b334eed63ca66
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Tue Dec 12 08:32:53 2023 -0800
Add an AD transport client (#1110)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 353dcaeb05f8b75fa74d92e2ae8415ab018bc68e
Author: Daniel Widdis <widdis@gmail.com>
Date: Wed Nov 22 13:59:53 2023 -0800
Fix build, update CVE-affected versions (#1102)
* Fix build, update CVE-affected versions
Signed-off-by: Daniel Widdis <widdis@gmail.com>
* Spotless depends on CVE-impacted eclipse dependency, now needs JDK17+
Signed-off-by: Daniel Widdis <widdis@gmail.com>
---------
Signed-off-by: Daniel Widdis <widdis@gmail.com>
commit 4c6ba48bf9fb9234ad8bc0b9193f3c68409acfb9
Author: Peter Zhu <zhujiaxi@amazon.com>
Date: Mon Oct 30 19:35:01 2023 -0400
Fix the bwc test version retrieval (#1093)
* Onboarding jenkins prod docker images to github actions
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
---------
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
commit a1da3aa0eefc6671446d2eb3bc670bad6449d2f0
Author: Peter Zhu <zhujiaxi@amazon.com>
Date: Mon Oct 30 19:14:31 2023 -0400
Onboarding jenkins prod docker images to github actions (#1092)
* Onboarding jenkins prod docker images to github actions
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
---------
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
commit 040cd7e33f8e696ffe7748140c9b0ecc7475d513
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:43:02 2023 -0700
dependabot: bump net.bytebuddy:byte-buddy from 1.14.6 to 1.14.9 (#1081)
Bumps [net.bytebuddy:byte-buddy](https://github.com/raphw/byte-buddy) from 1.14.6 to 1.14.9.
- [Release notes](https://github.com/raphw/byte-buddy/releases)
- [Changelog](https://github.com/raphw/byte-buddy/blob/master/release-notes.md)
- [Commits](https://github.com/raphw/byte-buddy/compare/byte-buddy-1.14.6...byte-buddy-1.14.9)
---
updated-dependencies:
- dependency-name: net.bytebuddy:byte-buddy
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit dd9c1521bc1946027245d65e39a7844cdf04a8b7
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:42:15 2023 -0700
dependabot: bump aws-actions/configure-aws-credentials (#1076)
Bumps [aws-actions/configure-aws-credentials](https://github.com/aws-actions/configure-aws-credentials) from 1.7.0 to 4.0.1.
- [Release notes](https://github.com/aws-actions/configure-aws-credentials/releases)
- [Changelog](https://github.com/aws-actions/configure-aws-credentials/blob/main/CHANGELOG.md)
- [Commits](https://github.com/aws-actions/configure-aws-credentials/compare/v1.7.0...v4.0.1)
---
updated-dependencies:
- dependency-name: aws-actions/configure-aws-credentials
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit d6e3fd7a69b1daea45d7a455335e55b6de118033
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:05:00 2023 -0700
dependabot: bump com.netflix.nebula.ospackage from 11.0.0 to 11.5.0 (#1066)
Bumps com.netflix.nebula.ospackage from 11.0.0 to 11.5.0.
---
updated-dependencies:
- dependency-name: com.netflix.nebula.ospackage
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 57eacf611ce44559e14aa37f2e51dfbb82d53cc2
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:04:19 2023 -0700
dependabot: bump org.apiguardian:apiguardian-api from 1.1.0 to 1.1.2 (#1058)
Bumps [org.apiguardian:apiguardian-api](https://github.com/apiguardian-team/apiguardian) from 1.1.0 to 1.1.2.
- [Release notes](https://github.com/apiguardian-team/apiguardian/releases)
- [Commits](https://github.com/apiguardian-team/apiguardian/compare/r1.1.0...r1.1.2)
---
updated-dependencies:
- dependency-name: org.apiguardian:apiguardian-api
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 6b9faf2b71e5481be366b12bd6f16440c6c8ef89
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:04:01 2023 -0700
dependabot: bump org.junit.platform:junit-platform-launcher (#1056)
Bumps [org.junit.platform:junit-platform-launcher](https://github.com/junit-team/junit5) from 1.9.2 to 1.10.0.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/commits)
---
updated-dependencies:
- dependency-name: org.junit.platform:junit-platform-launcher
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 2a957f2086688b5ee76703406105797d31207cc5
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:03:11 2023 -0700
Bump urllib3 from 1.26.9 to 1.26.17 in /dataGeneration (#1068)
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.9 to 1.26.17.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.9...1.26.17)
---
updated-dependencies:
- dependency-name: urllib3
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit a12e33214f9c138946975801cefa2bd39c7978a9
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 11:29:37 2023 -0700
dependabot: bump org.objenesis:objenesis from 3.0.1 to 3.3 (#1040)
Bumps [org.objenesis:objenesis](https://github.com/easymock/objenesis) from 3.0.1 to 3.3.
- [Release notes](https://github.com/easymock/objenesis/releases)
- [Commits](https://github.com/easymock/objenesis/compare/3.0.1...3.3)
---
updated-dependencies:
- dependency-name: org.objenesis:objenesis
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 5a4ba14a431fbc53f757416542cda25ef2fae58c
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 11:28:46 2023 -0700
dependabot: bump tibdex/github-app-token from 2.0.0 to 2.1.0 (#1065)
Bumps [tibdex/github-app-token](https://github.com/tibdex/github-app-token) from 2.0.0 to 2.1.0.
- [Release notes](https://github.com/tibdex/github-app-token/releases)
- [Commits](https://github.com/tibdex/github-app-token/compare/v2.0.0...v2.1.0)
---
updated-dependencies:
- dependency-name: tibdex/github-app-token
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 713d556d980ccb144eb6ae952cebc7b3963ed28c
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 15:05:44 2023 -0700
dependabot: bump actions/setup-java from 1 to 3 (#1035)
Bumps [actions/setup-java](https://github.com/actions/setup-java) from 1 to 3.
- [Release notes](https://github.com/actions/setup-java/releases)
- [Commits](https://github.com/actions/setup-java/compare/v1...v3)
---
updated-dependencies:
- dependency-name: actions/setup-java
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 574ac521653ede84e7b821bc3c06049f1054a6ad
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 10:53:02 2023 -0700
dependabot: bump tibdex/github-app-token from 1.5.0 to 2.0.0 (#1042)
Bumps [tibdex/github-app-token](https://github.com/tibdex/github-app-token) from 1.5.0 to 2.0.0.
- [Release notes](https://github.com/tibdex/github-app-token/releases)
- [Commits](https://github.com/tibdex/github-app-token/compare/v1.5.0...v2.0.0)
---
updated-dependencies:
- dependency-name: tibdex/github-app-token
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 65e207aef49a6872408ae02e4f49cdd9060c1ef0
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 10:52:40 2023 -0700
dependabot: bump org.apache.commons:commons-pool2 from 2.10.0 to 2.11.1 (#1045)
Bumps org.apache.commons:commons-pool2 from 2.10.0 to 2.11.1.
---
updated-dependencies:
- dependency-name: org.apache.commons:commons-pool2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit a4ff71926af39726d9b4584102706e3ea7f4fa05
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:16:31 2023 -0400
React to Tracer changes in TransportService (#1034)
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 05d0a3b905cae9d25f6d5d91f30f1b842b9a792f
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:14:20 2023 -0400
Ensure integ tests run with security after plugin rename (#1023)
* Ensure integ tests run with security after plugin rename
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Rename to time-series-analytics
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Switch folder back
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Run integTest with -i
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Remove opensearch-anomaly-detection if installed
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update password rules and change expected error msg
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update password generation
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Fix indexOf condition
Signed-off-by: Craig Perkins <cwperx@amazon.com>
---------
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 72210f014ab54bf4a5b567ebe9dabe13b66c6cbb
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:39 2023 -0700
dependabot: bump codecov/codecov-action from 1 to 3 (#1038)
Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 1 to 3.
- [Release notes](https://github.com/codecov/codecov-action/releases)
- [Changelog](https://github.com/codecov/codecov-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/codecov/codecov-action/compare/v1...v3)
---
updated-dependencies:
- dependency-name: codecov/codecov-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit b77c3a7406e94424550ec1f22f084bc20533994f
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:14 2023 -0700
dependabot: bump com.google.guava:guava from 32.0.1-jre to 32.1.2-jre (#1037)
Bumps [com.google.guava:guava](https://github.com/google/guava) from 32.0.1-jre to 32.1.2-jre.
- [Release notes](https://github.com/google/guava/releases)
- [Commits](https://github.com/google/guava/commits)
---
updated-dependencies:
- dependency-name: com.google.guava:guava
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 18defcc16e81abe590e8f109d6df3c4a060f74ce
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:03 2023 -0700
dependabot: bump VachaShah/backport from 1.1.4 to 2.2.0 (#1039)
Bumps [VachaShah/backport](https://github.com/vachashah/backport) from 1.1.4 to 2.2.0.
- [Release notes](https://github.com/vachashah/backport/releases)
- [Changelog](https://github.com/VachaShah/backport/blob/main/CHANGELOG.md)
- [Commits](https://github.com/vachashah/backport/compare/v1.1.4...v2.2.0)
---
updated-dependencies:
- dependency-name: VachaShah/backport
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 726759f104117e1a28648a1524cdface49168b79
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:53 2023 -0700
dependabot: bump actions/checkout from 2 to 4 (#1041)
Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v2...v4)
---
updated-dependencies:
- dependency-name: actions/checkout
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit f6ac01886a662264323d1e11a2199fb190148c80
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:38 2023 -0700
dependabot: bump org.jacoco:org.jacoco.ant from 0.8.5 to 0.8.10 (#1044)
Bumps [org.jacoco:org.jacoco.ant](https://github.com/jacoco/jacoco) from 0.8.5 to 0.8.10.
- [Release notes](https://github.com/jacoco/jacoco/releases)
- [Commits](https://github.com/jacoco/jacoco/compare/v0.8.5...v0.8.10)
---
updated-dependencies:
- dependency-name: org.jacoco:org.jacoco.ant
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit d30bcc394e6f281b6de504f102a0085ae56e78e4
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:22 2023 -0700
dependabot: bump org.junit.jupiter:junit-jupiter-api (#1043)
Bumps [org.junit.jupiter:junit-jupiter-api](https://github.com/junit-team/junit5) from 5.9.2 to 5.10.0.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/compare/r5.9.2...r5.10.0)
---
updated-dependencies:
- dependency-name: org.junit.jupiter:junit-jupiter-api
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 92256db92f9ed78cb1de9925297c9ff5cce6da74
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:04:23 2023 -0400
Add dependabot.yml (#1026)
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 23611f6d8ccdc9a4c41469ec0a4746290f976b4f
Author: Jackie Han <hnyng@amazon.com>
Date: Fri Sep 8 11:19:31 2023 -0700
Add 2.10 release notes (#1031)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit ee1db57058e08c36e4820637973f18016cf45015
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Wed Sep 6 16:55:00 2023 -0700
Updates demo certs for integ tests (#1018)
Signed-off-by: Owais Kazi <owaiskazi19@gmail.com>
commit 338d72eb692c81802a70fe42556cde70c01cad6a
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Sep 6 16:08:01 2023 -0700
refactor job response (#1017)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit db456c2543a6f1ff6b77db10bd19952768d16182
Author: Jackie Han <hnyng@amazon.com>
Date: Tue Sep 5 15:47:50 2023 -0700
upgrading commons-lang3 version to fix conflict issue (#1012)
* force commons-lang3 version to fix conflict issue
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from upstream version properties file
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* upgrading commons-lang3 version to align with core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit db788f4714233121eba4238869b8db89ae0037d4
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Tue Sep 5 13:58:31 2023 -0700
Adds auto release workflow (#1003)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 327c141e9b70465b1760f9ebf8c001a2e439b01f
Author: Jackie Han <hnyng@amazon.com>
Date: Fri Sep 1 13:00:23 2023 -0700
Revert "Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards (#948)" (#999)
This reverts commit bc1649922ef39619424fc16c64af5836e48a4a12.
commit 4a09b741e1c127a92775cb55f4c56aa5c4f3f6a3
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Aug 21 11:21:36 2023 -0700
Update Gradle Wrapper to 8.2.1 for Enhanced JDK20 Compatibility (#985)
- **Reason for Upgrade**: The migration to JDK20 ([reference](https://github.com/opensearch-project/opensearch-build/blob/aa65a8ecd69f77c3d3104043dd1c48dff708bffa/manifests/3.0.0/opensearch-3.0.0.yml#L9)) rendered the current Gradle version (7.6.1) incompatible.
- **Actions Taken**:
- **Gradle Wrapper Update**: Upgraded the Gradle wrapper to version 8.2.1 to maintain compatibility with JDK20. The gradle wrapper files are generated using the `./gradlew wrapper` command.
- Applied `spotless` due to new formatting requirements in Gradle 8.
- Resolved test "jar hell" issues. Gradle 8 introduced internal JARs to the test classpath that conflicted with dependencies from `org.junit.vintage:junit-vintage-engine`. As a remedy, these conflicting JARs have been excluded.
- **Relevant Pull Requests**:
- [Alerting#893](https://github.com/opensearch-project/alerting/pull/893/files)
- [ML-Commons#892](https://github.com/opensearch-project/ml-commons/pull/892)
- [Security PR](https://github.com/opensearch-project/security/pull/2978)
- **Verification**: Successfully verified the changes using `gradle build`.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 5ac6390e7de643d8177f0a5833995032f3a279ad
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Aug 17 11:08:36 2023 -0700
Refactoring task cache manager for forecasting (#982)
* Refactoring Shared Functionality for Broader Task Compatibility
This PR extracts shared components from `ADTaskCacheManager` into `TaskCacheManager` to support the requirements of the forecasting feature.
**Renamings**:
- **Method-level in `ADTaskCacheManager`**:
- `addDeletedDetector` to `addDeletedConfig`
- `addDeletedDetectorTask` to `addDeletedTask`
- `hasDeletedDetectorTask` to `hasDeletedTask`
- `pollDeletedDetector` to `pollDeletedConfig`
- `pollDeletedDetectorTask` to `pollDeletedTask`
- **Variable-level in `AnomalyDetectorSettings`**:
- `CHECKPOINT_MAINTAIN_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_MAINTAIN_QUEUE_MAX_HEAP_PERCENT`
- `CHECKPOINT_READ_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_READ_QUEUE_MAX_HEAP_PERCENT`
- `CHECKPOINT_SAVING_FREQ` to `AD_CHECKPOINT_SAVING_FREQ`
- `CHECKPOINT_TTL` to `AD_CHECKPOINT_TTL`
- `CHECKPOINT_WRITE_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_WRITE_QUEUE_MAX_HEAP_PERCENT`
- `COLD_ENTITY_QUEUE_MAX_HEAP_PERCENT` to `AD_COLD_ENTITY_QUEUE_MAX_HEAP_PERCENT`
- `DEDICATED_CACHE_SIZE` to `AD_DEDICATED_CACHE_SIZE`
- `ENTITY_COLD_START_QUEUE_CONCURRENCY` to `AD_ENTITY_COLD_START_QUEUE_CONCURRENCY`
- `ENTITY_COLD_START_QUEUE_MAX_HEAP_PERCENT` to `AD_ENTITY_COLD_START_QUEUE_MAX_HEAP_PERCENT`
- `EXPECTED_COLD_ENTITY_EXECUTION_TIME_IN_MILLISECS` to `AD_EXPECTED_COLD_ENTITY_EXECUTION_TIME_IN_MILLISECS`
- `FILTER_BY_BACKEND_ROLES` to `AD_FILTER_BY_BACKEND_ROLES`
- `MAX_ENTITIES_PER_QUERY` to `AD_MAX_ENTITIES_PER_QUERY`
- `MAX_MODEL_SIZE_PER_NODE` to `AD_MAX_MODEL_SIZE_PER_NODE`
- `MAX_MULTI_ENTITY_ANOMALY_DETECTORS` to `AD_MAX_HC_ANOMALY_DETECTORS`
- `MAX_RETRY_FOR_END_RUN_EXCEPTION` to `AD_MAX_RETRY_FOR_END_RUN_EXCEPTION`
- `MAX_SINGLE_ENTITY_ANOMALY_DETECTORS` to `AD_MAX_SINGLE_ENTITY_ANOMALY_DETECTORS`
- `MODEL_MAX_SIZE_PERCENTAGE` to `AD_MODEL_MAX_SIZE_PERCENTAGE`
- `PAGE_SIZE` to `AD_PAGE_SIZE`
- `RESULT_WRITE_QUEUE_MAX_HEAP_PERCENT` to `AD_RESULT_WRITE_QUEUE_MAX_HEAP_PERCENT`
- **Class-level**:
- `ADRealtimeTaskCache` renamed to `RealtimeTaskCache`
- **Package-level**:
- Shifted from `org.opensearch.ad.breaker` to `org.opensearch.timeseries.breaker`
**Migrations**:
- Variables transferred from `AnomalyDetectorSettings` to `TimeSeriesSettings`:
- `BATCH_BOUNDING_BOX_CACHE_RATIO`
- `CHECKPOINT_MAINTAIN_REQUEST_SIZE_IN_BYTES`
- `CHECKPOINT_WRITE_QUEUE_SIZE_IN_BYTES`
- `DEFAULT_AD_JOB_LOC_DURATION_SECONDS` (renamed to `DEFAULT_JOB_LOC_DURATION_SECONDS`)
- `ENTITY_REQUEST_SIZE_IN_BYTES`
- `HOURLY_MAINTENANCE`
- `INTERVAL_RATIO_FOR_REQUESTS`
- `LOW_SEGMENT_PRUNE_RATIO`
- `MAINTENANCE_FREQ_CONSTANT`
- `MAX_COLD_START_ROUNDS`
- `MAX_QUEUED_TASKS_RATIO`
- `MAX_TOTAL_RCF_SERIALIZATION_BUFFERS`
- `MAX_CHECKPOINT_BYTES`
- `MEDIUM_SEGMENT_PRUNE_RATIO`
- `NUM_MIN_SAMPLES`
- `NUM_SAMPLES_PER_TREE`
- `NUM_TREES`
- `QUEUE_MAINTENANCE`
- `RESULT_WRITE_QUEUE_SIZE_IN_BYTES`
- `SERIALIZATION_BUFFER_BYTES`
- `THRESHOLD_MIN_PVALUE`
- `TIME_DECAY`
**Deletions**:
- Obsolete settings and methods:
- `DESIRED_MODEL_SIZE_PERCENTAGE` in `AnomalyDetectorSettings`
- `getDesiredModelSize` in `MemoryTracker`
**Modifications**:
- `MemoryTracker` enums renamed for clear differentiation between real-time and historical memory usage, adding `REAL_TIME_FORECASTER` for a harmonized single-stream and HC analysis approach.
**Tests**:
- Changes validated with a successful Gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 0c5b4b94cb5b192160463fa8a5f58eac587fe95d
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Aug 15 13:09:17 2023 -0700
Update RCF to v3.8 and Enable Auto AD with 'Alert Once' Option (#979)
* Update RCF to v3.8 and Enable Auto AD with 'Alert Once' Option
This PR added support for automatic Anomaly Detection (AD) and the 'Alert Once' option introduced in RCF 3.8.
Testing done:
1. Deserialization Test:
* Verified model deserialization from 3.0-rc3.
* Ensured consistent scoring using the rc3 checkpoint and rc3 dependency on identical data.
2. Backward Compatibility Test:
* Executed a mixed cluster with versions 2.10 and 3.0.
* Validated that older detectors still produce results without throwing any exceptions in a blue-green simulation scenario.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* reduce recall since alertOnce reduced recall
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* remove commented out code
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit cadc9bbd949daf4f2669335bfb8629e2137c108d
Author: Joshua Palis <jpalis@amazon.com>
Date: Fri Aug 11 16:02:38 2023 -0700
Fixing imports, adding TermsAggregator BucketCountThresholds for StringTerms, setting AnomalyResult grade to 0 if negative value (#976)
Signed-off-by: Joshua Palis <jpalis@amazon.com>
commit 3985cd2f82f2cfa57604ecf5a512bb042e632cae
Author: Romain Tartière <romain@blogreen.org>
Date: Wed Aug 9 08:59:30 2023 -1000
Fix build with latest OpenSearch (for real this time) (#972)
This is a follow-up to #971, where commit
2839bc2c6f470639b68901086c80cb2152d96558 only fixed _some_ but not _all_
of the build errors (it allowed `./gradlew run` to pass but `./gradlew
build` was failing).
Fix the build errors when we run `./gradlew build`.
Signed-off-by: Romain Tartière <romain@blogreen.org>
commit 2839bc2c6f470639b68901086c80cb2152d96558
Author: Romain Tartière <romain@blogreen.org>
Date: Tue Aug 8 13:15:04 2023 -1000
Fix build with latest OpenSearch (#971)
OpenSearch recently merged some code that cause buid failure for this
module, as spotted in #585.
This change the import to match the new one after
https://github.com/opensearch-project/OpenSearch/pull/9103
Signed-off-by: Romain Tartière <romain@blogreen.org>
commit d4946f04e7ad44f0bc79215962c6678786c592ff
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Aug 7 14:21:56 2023 -0700
Refactor ADTask and Related Components (#969)
* Refactor ADTask and Related Components
This PR includes several key refactoring changes:
- Extracts common code from ADTask into TimeSeriesTask, creating ForecastTask for forecasting-specific logic.
- Consolidates common code from ADTaskType into TaskType and introduces ForecastTaskType for forecasting-related purposes.
- Renames ADTaskState to TaskState for consistent code reuse.
- Renames the method getId in ADTask to getConfigId to differentiate it from other IDs like task id.
Testing done:
1. Added unit tests for the new code to ensure functionality.
2. Executed a successful Gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* add comments and address compiler errors
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Amit's comments and address compiler failure
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 1130a1ba6fc3c08f375dd99f98e93e4ee36331fb
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jul 27 10:39:39 2023 -0700
Refactoring NodeStateManager etc. to support forecasting functionality (#965)
* Refactoring NodeStateManager etc. to support forecasting functionality
This commit extends the codebase to support both Anomaly Detection (AD) and forecasting. It contains a mixture of refactoring, renaming, removal of unused code, and package moving tasks. Here are the details:
Refactoring:
- `NodeStateManager.getAnomalyDetector` is now `getConfig`, with added functionality to fetch a Forecaster. The method comments are updated for clarity.
- Existing methods (`getFeatureSamplesForPeriods`, `getColdStartSamplesForPeriods`, `createPreviewSearchRequest`, `getMinDataTime`) have been added in `SearchFeatureDao` to handle forecasting logic.
- Adjusted `SecurityClientUtil` and `ParseUtils` to handle forecasting logic.
- Cleaned up `NodeState` to differentiate state for AD and forecasting.
Renaming:
- `AnomalyDetectorJob` is renamed to `Job` to facilitate reuse for forecasting.
- `NodeStateManager.getAnomalyDetectorJob` is renamed to `getJob`.
- Certain settings in `AnomalyDetectorSettings` are renamed to reflect they are meant for the AD setting. They have been marked as deprecated and new settings are used in `TimeSeriesSettings` instead.
- `IndexAnomalyDetectorJobActionHandler.getAnomalyDetectorJobForWrite` is renamed to `getJobForWrite`.
- `ADSafeSecurityInjector` is renamed to `TimeSeriesSafeSecurityInjector`.
Removing unused code:
- Synchronous code in `ClientUtil`, `IndexUtils`, and `CheckpointDao` is removed.
- The unused class `Throttler` is deleted.
- Mapping file names are changed, and the code referencing these files is adjusted.
Package moving:
- Several classes (`ClientUtil`, `MultiResponsesDelegateActionListener`, `SafeSecurityInjector`, `SecurityUtil`, `ExceptionUtil`, `SearchFeatureDao`, `CleanState`, `ExpiringState`, `MaintenanceState`, `NodeState`, `SingleStreamModelIdMapper`, `BackPressureRouting`) are moved to the respective `org.opensearch.timeseries` packages.
Miscellaneous:
- Fixed compiler failures caused by changes in https://github.com/opensearch-project/OpenSearch/pull/8730 by replacing `DoubleArrayList` with `java.util.ArrayList`.
- Updates the Backwards Compatibility (bwc) version to align with the core's incremented bwc version as per [OpenSearch PR #8670](https://github.com/opensearch-project/OpenSearch/pull/8670). This change prevents the issue described in [OpenSearch Issue #5076](https://github.com/opensearch-project/OpenSearch/issues/5076).
Testing:
- Executed a `gradle build`.
- Added new tests for `ClientUtil` and `NodeStateManager`.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comment
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* fix compiler error and comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit f0ed43b1aa3c5d80dc6f23a5dd4465bb03ef1739
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jul 17 15:18:03 2023 -0700
Rename AD to time series analytics & Resolve Compiler Errors (#951)
This commit focuses on renaming the AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin as well as addressing compiler errors due to package import changes. The primary transformations are:
* Renamed AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin.
* Updated all references from AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin.
* Amended plugin information in build.gradle and src/main/resources/es-plugin.properties.
* Switched job type in TimeSeriesAnalyticsPlugin from opendistro_anomaly_detector to opensearch_time_series_analytics.
These changes led to the modification of our plugin binary from opensearch-anomaly-detection-3.0.0.0-SNAPSHOT.jar to opensearch-time-series-analytics-3.0.0.0-SNAPSHOT.jar.
Moreover, following changes from OpenSearch Pull Request #8157, compiler errors were encountered, which were resolved by updating the import packages
* org.opensearch.common.io.stream.NamedWriteableRegistry => org.opensearch.core.common.io.stream.NamedWriteableRegistry
* org.opensearch.common.xcontent.XContentParserUtils => * org.opensearch.core.xcontent.XContentParserUtils
* org.opensearch.common.bytes.BytesArray => org.opensearch.core.common.bytes.BytesArray * org.opensearch.common.io.stream.StreamInput => * org.opensearch.core.common.io.stream.StreamInput ** org.opensearch.common.io.stream.StreamOutput => org.opensearch.core.common.io.stream.StreamOutput
* org.opensearch.common.io.stream.Writeable => org.opensearch.core.common.io.stream.Writeable
* org.opensearch.common.io.stream.NotSerializableExceptionWrapper => org.opensearch.core.common.io.stream.NotSerializableExceptionWrapper
* org.opensearch.rest.RestStatus => org.opensearch.core.rest.RestStatus
* org.opensearch.common.ParsingException => org.opensearch.core.common.ParsingException
* org.opensearch.common.bytes.BytesReference => org.opensearch.core.common.bytes.BytesReference
* org.opensearch.common.io.stream.InputStreamStreamInput => org.opensearch.core.common.io.stream.InputStreamStreamInput
* org.opensearch.common.io.stream.OutputStreamStreamOutput => org.opensearch.core.common.io.stream.OutputStreamStreamOutput
* org.opensearch.index.shard.ShardId => org.opensearch.core.index.shard.ShardId* org.opensearch.index.Index => org.opensearch.core.index.Index
* org.opensearch.core.index.IndexNotFoundException => org.opensearch.index.IndexNotFoundException
Validation steps were executed to ensure these changes did not break functionality:
* gradle build was successful. A local build was required due to outdated OpenSearch and job scheduler nightly builds.
* Backward compatibility tests were performed on a two-node 2.9 cluster running some detectors. These detectors continued to produce results on a 3.0 cluster with these updates.
* I can start new detectors on the 3.0 node.
* After shutting down a 2.9 node, the job transfer to the 3.0 node was successful and the job continued to perform as expected.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit c7c6a46e88e15f615fc9dae0499cf0d674662057
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Thu Jul 13 15:42:46 2023 -0700
Add 2.9 release notes (#952)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit bc1649922ef39619424fc16c64af5836e48a4a12
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Jul 11 13:34:09 2023 -0700
Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards (#948)
* Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards
In this PR, we temporarily enforce DOCUMENT replication for AD indices. This change is necessary due to the current limitation of SegRep, which doesn't support Get/MultiGet by ID. This measure will be in place until SegRep adds support for these operations.
This adjustment aligns with the modification made in the referenced PR: job-scheduler PR #417
Additionally, this PR increases the number of primary shards for forecasting indices from 10 to 20, recognizing the higher write intensity of these indices. For instance, when the horizon is 24, we are expected to save 25 documents: 24 for each forecast and 1 for the actual value. In contrast, for AD, we save one document per actual value.
Testing done:
1. gradle build passed
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Fix comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit a1203827617ee42b35d41cb8b010719f334f73b7
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jul 10 10:53:17 2023 -0700
Add ForecastResult and Refactor Shared Code (#941)
This commit adds the functionality of ForecastResult, while also performing several necessary refactorings.
Firstly, we introduce ForecastResult, which closely mirrors the functionality of AnomalyResult. Any shared code between these two classes has been abstracted out into a new parent class, IndexableResult. This refactoring was undertaken to facilitate code reuse and improve maintainability, as both classes deal with storing fields that need to be saved in result indices.
Secondly, we've also extracted common code from ThresholdingResult into another new class, IntermediateResult. This work is in preparation for a forthcoming PR which will introduce RCFCasterResult. In this change, we moved the 'toAnomalyResult' method to IndexableResult, and renamed it to 'toIndexableResults'. This renaming allows for reuse in the upcoming RCFCasterResult. The updated method now returns a list of results instead of a single result. The shift caters for the RCFCasterResult use case where one RCFCasterResult is stored across multiple ForecastResult documents.
Furthermore, this commit modifies the 'entity' field in several methods to be of the Optional type, indicating that it can be empty. This change provides a clear signal to other developers about the optional nature of these fields.
In addition, this commit updates the mapping for the forecast result index. The prior mapping was a placeholder and this change brings it up to date.
We've also moved to using httpcore5 and httpclient5 versions from OpenSearch core, as necessitated by recent changes in [OpenSearch PR #8434](https://github.com/opensearch-project/OpenSearch/pull/8434/files). This shift resolves potential jar hell issues with httpcore5 and httpclient5.
Lastly, we've made name and package changes:
1. Renamed 'initDetectionStateIndex' in ADIndexManagement to 'initStateIndex' to align with ForecastIndexManagement naming.
2. Moved the 'DataByFeatureId' class to the 'timeseries' package for better organization.
This commit also completes the 'createDummyIndexRequest' method in ForecastIndexManagement by invoking 'ForecastResult.getDummyResult()', which is now possible due to the introduction of the ForecastResult implementation.
Testing done:
1. added tests for new code
2. gralde build passes
3. e2e tests
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit f24d9e32ff739abf29cac3da15fd00f74219e213
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Thu Jul 6 17:28:09 2023 -0700
Bump scipy from 1.8.0 to 1.10.0 in /dataGeneration (#943)
Bumps [scipy](https://github.com/scipy/scipy) from 1.8.0 to 1.10.0.
- [Release notes](https://github.com/scipy/scipy/releases)
- [Commits](https://github.com/scipy/scipy/compare/v1.8.0...v1.10.0)
---
updated-dependencies:
- dependency-name: scipy
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 9b9fd2ba3f3e678d717c0a45af8069bb67828808
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Jun 27 16:08:55 2023 -0700
bump guava version to 32.0.1 (#933)
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit 99749dfa6bfc8a2f2c4660ca01d75d1ad57124a5
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jun 26 16:46:24 2023 -0700
Refactoring Index Creation for Improved Code Reuse and Consistency (#932)
This Pull Request significantly refactors the index creation module to promote greater code reusability and consistency. The primary changes are outlined as follows:
1. Code Migration: Common code segments have been moved from AnomalyDetectionIndices to IndexManagement. In addition, component-specific code has been established in ADIndexManagement and ForecastIndexManagement. The bulk of changes are concentrated in these three classes, with the remainder of the modifications relating to reference/test changes.
2. Function Renaming: Several functions have been renamed for broader applicability and consistency:
* AnomalyDetectorFunction has been renamed to ExecutorFunction for potential use in Forecasting.
* AnomalyDetectorSettings.MAX_PRIMARY_SHARDS has been renamed to AnomalyDetectorSettings.AD_MAX_PRIMARY_SHARDS in light of the new ForecastSettings.FORECAST_MAX_PRIMARY_SHARDS.
* doesAnomalyDetectorJobIndexExist() has been renamed to doesJobIndexExist() to allow for job index reusability across Anomaly Detection (AD) and forecasting. Analogous changes have been made to other job index-related functions.
* doesAnomalyDetectorIndexExist() has been renamed to doesConfigIndexExist() to allow for config index reusability across AD and forecasting. Analogous changes have been made to other config index-related functions.
* detectionIndices.doesDetectorStateIndexExist() has been renamed to detectionIndices.doesStateIndexExist(), as the former name was unnecessarily redundant. Similar modifications have been made to the result and checkpoint index.
3. Class Migration: The classes ThrowingSupplierWrapper, ThrowingConsumer, and ThrowingSupplier have been moved from org.opensearch.ad.util to org.opensearch.timeseries.function to promote code reuse.
4. Initial Forecast Indices' Mapping: An initial version of forecast indices' mapping has been added, which can be adjusted as required in the future.
5. In terms of version updates, 2.x has been bumped to 2.9, prompting an increment of the Backward Compatibility (BWC) test version to 2.9.
6. Update dependency com.google.guava:guava to v32 for cve fix.
Testing done:
Testing has been performed with new tests added for forecast index creation, and the grade build passes successfully.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit aedb781a6b1df984636d72d50b65d41138539918
Author: Craig Perkins <craig5008@gmail.com>
Date: Tue Jun 20 16:55:19 2023 -0400
Fix main build - update import of Releasable and remove reference to BaseExceptionsHelper (#930)
* Fix main build - update import of Releasable and remove reference to BaseExceptionsHelper
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update imports in test classes
Signed-off-by: Craig Perkins <cwperx@amazon.com>
---------
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit fce78c29c0375ae06f56e16c85fb98933401e28f
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Jun 14 10:36:40 2023 -0700
Refactor: Reorganize code for Forecasting and AnomalyDetector packages (#925)
* Refactor: Reorganize code for Forecasting and AnomalyDetector packages
This PR includes several refactorings to increase code reuse and improve readability:
1. Entity, FeatureData, and RestHandlerUtils have been moved from the 'ad' package to the 'timeseries' package, enabling their use within the Forecasting code.
2. A new class, DataByFeatureId, has been created to hold shared code previously located in FeatureData. FeatureData now inherits from DataByFeatureId. The standalone usage of DataByFeatureId will be detailed in subsequent PRs.
3. Renamed checkAnomalyDetectorFeaturesSyntax to checkFeaturesSyntax in RestHandlerUtils to make it more generic and usable for Forecasting.
4. Constants AGG_NAME_MAX_TIME, AGG_NAME_MIN_TIME, DATE_HISTOGRAM, and FEATURE_AGGS have been moved from ADCommonName to CommonName to make them accessible for Forecasting.
5. A new method, parseConfig, has been added to the Config class. This method can parse configuration for either AnomalyDetector or Forecaster based on input.
Testing:
The changes have been validated with a successful gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Amit and Owais's comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 02c120f025f73f3d45a8477c7ef8b4873befebfa
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jun 12 11:54:39 2023 -0700
Updated Maintainers and CODE_OWNERS list (#926)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 2ea4dcf430b40a710a0babb04881eeff9fb2d689
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jun 8 15:11:44 2023 -0700
Add Forecaster class (#920)
* Add Forecaster class
This PR adds class Forecaster that serves as the configuration POJO for forecasting. Shared code between AnomalyDetector and Forecaster is extracted and moved to the Config class to reduce duplication and promote reusability. References to the common code in related classes have also been adjusted.
Testing done:
1. gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* fix compiler error due to a recent core change
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Sudipto and Amit's comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit ee04225349a5f0f003d56e77a3243386f4a9673d
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri Jun 2 15:42:19 2023 -0700
Refactor: Migrate files from 'ad' to 'timeseries' package (#918)
* Refactor: Migrate files from 'ad' to 'timeseries' package
This commit involves moving various files from the 'ad' package to the 'timeseries' package. All changes to dependent imports were handled automatically through the IDE, and no changes to file contents were made in the process.
Testing done:
- gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* move ParseUtils to util package
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 472868d165c2234eece8827584f64086aaf7ae92
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jun 1 11:17:16 2023 -0700
Refactor Shared Settings, Introduce Dynamic Forecast Settings, Rename (#912)
* Refactor Shared Settings, Introduce Dynamic Forecast Settings, and Rename Checkpoint mapping File
This commit has undertaken three changes:
* Refactoring of Shared Settings: I've performed a refactoring to unify the settings that are shared between the AD and forecasting modules.
* Introduction of Dynamic Forecast Settings: To increase the adaptability of our system, I've implemented dynamic forecast settings. These settings mirror the existing structure of the AD dynamic settings and will enable us to adjust forecast settings on-the-fly.
* Renaming of Checkpoint File: To enhance the consistency across our AD mapping files, I've renamed checkpoint.json to anomaly-checkpoint.java.
Testing done:
1. added tests for new settings.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* name change and delete files
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 04ab91e60e9d71765a7b9df10b86e0e53ba4d715
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 31 12:18:54 2023 -0700
add 2.8 release notes (#915)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 98da8dffe8d336793ae35658015650b0f83aeef1
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 24 14:37:38 2023 -0700
Implementing Multiple Imputation Methods for Missing Values (#907)
* Implementing Multiple Imputation Methods for Missing Values
This Pull Request introduces multiple imputation methods to handle missing data in Anomaly Detection (AD) and forecasting. The ability to handle missing data is crucial to improve the robustness and accuracy of our models.
The following imputation methods have been implemented:
* Zero Imputation (ZERO): This method replaces all missing values with 0's. It's a simple approach, but it may introduce bias if the data is not centered around zero.
* Fixed Values Imputation (FIXED_VALUES): This method replaces missing values with a predefined set of values. The values are the same for each input dimension, and they need to be specified by the user.
* Previous Value Imputation (PREVIOUS): This method replaces missing values with the last known value in the respective input dimension. It's a commonly used method for time series data, where temporal continuity is expected.
* Linear Interpolation (LINEAR): This method estimates missing values by interpolating linearly between known values in the respective input dimension. This method assumes that the data follows a linear trend.
These methods are designed to provide a set of options for users to handle missing data based on their specific needs and the nature of their data.
Testing Done:
The code changes in this pull request have been validated through a gradle build to ensure that all new and existing tests pass successfully.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Various changes
The commit makes all new files use the shortened header text and addresses compiler/test issues due to core refactoring
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit da608aaa3d3f955efe32b0cb33b3c8cfdd7a7718
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue May 16 11:37:34 2023 -0700
Code Refactoring for CommonMessages (#902)
* Code Refactoring for CommonMessages
In this pull request, I have refactored the code related to shared log or error messages in both AD and forecasting modules to CommonMessages. Additionally, the previously used CommonErrorMessages has been renamed to ADCommonMessages. For the Forecasting module, I have introduced new names in ForecastCommonMessages.
Testing done:
* gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Update string constants wording
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve wording and remove redundant variables
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 041d6ce73d37f1697013b2d2f0683fbfe012247c
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri May 12 13:05:56 2023 -0700
Code Refactoring for CommonName (#901)
In this pull request, I have refactored the code related to shared names in both AD and forecasting modules to CommonNames. Additionally, the previously used CommonName has been renamed to ADCommonName. For the Forecasting module, I have introduced new names in ForecastCommonNames.
Testing done:
* gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit e2fee9d6ba59cc2a23eadbb50a80414fcc7dbf8f
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 10 17:26:31 2023 -0700
Update outdated MAINTAINERS and OWNERS list (#898)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 98b566d1ec57ffd8970b5180c54b493deb1a24ac
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Wed May 10 18:03:04 2023 -0400
Sync up CODEOWNERS with MAINTAINERS.md. (#897)
Signed-off-by: dblock <dblock@amazon.com>
commit 1f8415aa39fa4ec3ba016214255aa0e79b7c7d63
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue May 9 12:55:35 2023 -0700
Various fixes (#886)
* Various fixes
This pull request addresses several issues related to the compiler and tests in the current main branch.
The first major change involves replacing ImmutableOpenMap with java.util.Map in the core. This modification is implemented in the following pull requests:
https://github.com/opensearch-project/OpenSearch/pull/7165
https://github.com/opensearch-project/OpenSearch/pull/7301
To accommodate this change, the codebase of the AD (Anomaly Detection) module has been refactored to utilize JDK maps. As a consequence of this change, passing null to the custom parameters of ClusterState is no longer permissible, as it leads to a NullPointerException. The error stack trace is as follows:
java.lang.NullPointerException: Cannot invoke "Object.getClass()" because "m" is null
at __randomizedtesting.SeedInfo.seed([60CDDB34427ACD0C:6E72DB4ED18E018D]:0)
at java.base/java.util.Collections.unmodifiableMap(Collections.java:1476)
at org.opensearch.cluster.ClusterState.<init>(ClusterState.java:219)
at org.opensearch.ad.transport.DeleteAnomalyDetectorTests.createClusterState(DeleteAnomalyDetectorTests.java:216)
at org.opensearch.ad.transport.DeleteAnomalyDetectorTests.testDeleteADTransportAction_LatestDetectorLevelTask(DeleteAnomalyDetectorTests.java:160)
To address this issue, we have replaced the usage of null with new HashMap<>().
The second change in this pull request aligns with the modifications introduced in PR https://github.com/opensearch-project/anomaly-detection/pull/878.
The third issue is related to the incompatibility between tests that utilize the @Parameters annotation and those that do not, as explained in https://tinyurl.com/2y265s2w. Specifically, the SearchFeatureDaoTests class runes tests with the @Parameters annotation, whereas SearchFeatureDao tests do not.
Testing done:
1. gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 0a48da9e1a0cd70c64cc2da228674baaf377c89e
Author: Jackie Han <hnyng@amazon.com>
Date: Mon Apr 17 12:44:06 2023 -0700
Add 2.7 release notes (#871)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 1edc2ef1ccfe20938711984744b20d1f2ec96a3c
Author: Jackie Han <hnyng@amazon.com>
Date: Tue Apr 11 17:53:57 2023 -0700
Update OpenSearchRejectedExecutionException import (#861)
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update NodeInfo constructor and javadoc for isAdmin method
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit b8df172c2364997c446096e960068d6fc5d2e6f6
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Apr 11 10:55:28 2023 -0700
Giving admin priority over backendrole filtering (#850)
* giving admin priority over backend role filtering
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
* fix security tests
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
* remove redundent line in test case
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
---------
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit fd2fd5d5f63c9004b9f265e3c1e4475282447da8
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Thu Mar 16 14:30:32 2023 -0400
Created untriaged issue workflow. (#809)
Signed-off-by: dblock <dblock@amazon.com>
commit fd547014fdde5114bbc9c8e49fe7aaa37eb6e793
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Mar 1 16:41:05 2023 -0800
Publish snapshots to maven via GHA, fix spotless errors, and bump bwc version (#827)
We are de-coupling the task of publishing the maven snapshots from centralized build workflow to individual repositories. This PR publishes maven snapshots using GitHub Actions.
Testing done:
1. ran ./gradlew publishPluginZipPublicationToSnapshotsRepository according to https://github.com/opensearch-project/anomaly-detection/issues/813
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit b6be5960fb8cff41f0e9d13d5f5a971c289b80ed
Author: Jackie Han <hnyng@amazon.com>
Date: Thu Feb 23 12:23:01 2023 -0800
Update xcontent imports (#822)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 1dcb78a6c4d1331133aefe5af7adf137daa8846f
Author: Jackie Han <hnyng@amazon.com>
Date: Wed Feb 22 11:17:21 2023 -0800
Add 2.6 release note (#818)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 553688aae45590c37cc4d86102642d0b3a6ebb33
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Feb 9 13:38:14 2023 -0800
Revert changes to exception message (#803)
* Revert changes to exception message
We used to log "No RCF models are available either because RCF models are not ready..." and now we log "resource_not_found_exception: No checkpoints found for model id...". This change caused an integration test failure. This PR reverts it back.
Testing done:
1. verified that the original log is back.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* check NO_MODEL_ERR_MSG instead of NO_CHECKPOINT_ERR_MSG
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit c9bdc628a03c4ced3cd1ebeec44ebff792d7ff98
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri Feb 3 11:15:37 2023 -0800
fixing dls/fls logic around numeric aggregations (#801)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 9cebc5bc97a84dd78ac8892863ff7d674428bced
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Jan 10 02:17:04 2023 +0000
adding 2.5 release notes
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit 2ace84643fd199a5e5179e6d21ab76ae212cb7d8
Author: Ryan Bogan <10944539+ryanbogan@users.noreply.github.com>
Date: Tue Jan 10 13:31:49 2023 -0800
Add jackson back to build.gradle (#780)
Signed-off-by: Ryan Bogan <rbogan@amazon.com>
commit a5d60eefab5ac30ef5243da8e7a88b7a2189cd5c
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jan 9 15:49:35 2023 -0800
bump bwc to 2.6.0 (#775)
We need to bump the version because only the latest 2.x will be upgradable to 3.0 when that ship. Since OpenSearch core bumped to 2.6, we need to do that as well. Note after bumping version, bwc still fails to find 2.6.0 core zip.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 27ed49863bfbef90551cdfacc6b51703bf622e25
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jan 9 12:17:57 2023 -0800
Fix the discrepancy between Profile API and real time tasks API (#770)
* Fix the discrepancy between Profile API and real time tasks API
This PR fixes the discrepancy by querying the result index when the total updates is less than 32. We have done similar things in profile API so I refactored reusable code to ProfileUtil. We also cached whether we have queried the result index and won't repeatedly issue the extra query.
Testing done:
1. repeated repro steps in https://github.com/opensearch-project/anomaly-detection/issues/502 and verified the issue has been resolved.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit b49a36b3e7962a205695d451e0497ee4f57fb2cb
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Thu Jan 5 10:19:51 2023 -0800
Updated MAINTAINERS.md to match recommended opensearch-project format. (#771)
Signed-off-by: dblock <dblock@amazon.com>
commit 20d2c5f94811f62a7077142ba505bed272a83549
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Dec 20 13:16:21 2022 -0800
update bwc to 2.5 (#765)
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit e08314f43a22d2692e8467efae3699fce0440611
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Dec 20 11:00:45 2022 -0800
[Forward-Port to main] Fix _source bug (#749) (#764)
* Fix _source bug (#749)
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
* fixed strings method
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit 134942ed61b984e57b1f9c6bc7d416232d8f59d2
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri Dec 16 09:38:46 2022 -0800
Speed up cold start (#753)
* Speed up cold start
If historical data is enough, a single stream detector takes 1 interval for cold start to be triggered + 1 interval for the state document to be updated. Similar to single stream detectors, HCAD cold start needs 2 intervals and one more interval to make sure an entity appears more than once. So HCAD needs three intervals to complete cold starts. Long initialization is the single most complained problem of AD. This PR reduces both single stream and HCAD detectors' initialization time to 1 minute by
* delaying real time cache update by one minute when we receive ResourceNotFoundException in single stream detectors or when the init progress of HCAD real time cache is 0. Thus, we can finish the cold start and writing checkpoint one minute later and update the state document accordingly. This optimization saves one interval to wait for the state document update.
* disable the door keeper by default so that we won't have to wait an extra interval in HCAD.
* trigger cold start when starting a real time detector. This optimization saves one interval to wait for the cold start to be triggered.
Testing done:
* verified the cold start time is reduced to 1 minute.
* added tests for new code.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 609abe42df8af450e48bfa122746361f7a8201c7
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Thu Dec 15 17:11:10 2022 -0500
Fix: typo in ohltyler. (#760)
Signed-off-by: dblock <dblock@amazon.com>
commit ce3d747317aec5ccef080c767d4ba8e7015c5a2a
Author: Varun Jain <varunudr@amazon.com>
Date: Tue Dec 6 15:44:33 2022 -0800
Model Profile Test (#748)
commit 09b4cc1ac3ab9fb4e589754acba619d265603580
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Mon Dec 5 12:06:16 2022 -0800
Use sonatype to fetch JS instead of ci.opensearch.org (#740)
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit a3e2b994ed347263a8dbaf5beed6bd5ddd6931a4
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Nov 30…
kaituo
added a commit
to kaituo/anomaly-detection-1
that referenced
this pull request
Mar 27, 2024
commit 30347847cb4ec87f7318587d97054d91c341a312
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Mar 26 13:40:53 2024 -0700
Upgrade rcf to 4.0 (#1173)
This PR upgrades rcf to 4.0 as it has bug fixes and support for streaming imputation mode.
Testing done:
1. gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 8ca1d0d837dd28b6e0820756136eafb8c3ce03ad
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Mar 25 13:44:45 2024 -0700
dependabot: bump actions/checkout from 3 to 4 (#1098)
Bumps [actions/checkout](https://github.com/actions/checkout) from 3 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v3...v4)
---
updated-dependencies:
- dependency-name: actions/checkout
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit d0a2a8ff9fd9640000763c433e05577eea292c48
Author: Darshit Chanpura <35282393+DarshitChanpura@users.noreply.github.com>
Date: Mon Mar 25 16:44:36 2024 -0400
Updates sample cert and admin keystore (#1163)
Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
commit 1921e12b30ac442cd731a5d7a3bdfd3bc31be82b
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Mar 25 13:14:52 2024 -0700
Bump urllib3 from 1.26.17 to 1.26.18 in /dataGeneration (#1090)
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.17 to 1.26.18.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.17...1.26.18)
---
updated-dependencies:
- dependency-name: urllib3
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 8521a76533b533d6887321505c7b5e3d473b02ae
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Mar 25 13:14:18 2024 -0700
dependabot: bump org.apache.commons:commons-pool2 from 2.11.1 to 2.12.0 (#1088)
Bumps org.apache.commons:commons-pool2 from 2.11.1 to 2.12.0.
---
updated-dependencies:
- dependency-name: org.apache.commons:commons-pool2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 303ceb5b320f148dcd015ab6a11f870ae3e23125
Author: Joshua Palis <jpalis@amazon.com>
Date: Mon Mar 18 16:49:59 2024 -0700
Adding 2.13 release notes (#1170)
Signed-off-by: Joshua Palis <jpalis@amazon.com>
commit 1507dd4b4045bd8e8cdf505d07041ce304788ca0
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Feb 21 15:59:34 2024 -0800
Inject NamedWriteableRegistry in AD node client (#1164)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 5b85720d442d1b43001dde0c20248fd4a20a64b0
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Tue Feb 13 10:20:20 2024 -0800
Fixed lucene url (#1158)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 290bdcd832a0cae6d039787d9f0af73ea6be2ec2
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Feb 6 16:14:49 2024 -0800
add 2.12 release notes (#1152)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 6a6eec347379c997f0f7acc88b027bc1ffdd8f54
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Tue Jan 30 18:20:36 2024 -0800
Add ser/deser to get AD transport action request (#1150)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 475f0c36e5b6267aaeb101627b9c3ae1fcca3a88
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Thu Jan 25 14:37:12 2024 -0800
Updated lucene snapshot url (#1146)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 7192d848d2923566a409901909f342a63695e1c2
Author: Jackie Han <hnyng@amazon.com>
Date: Thu Jan 25 09:48:37 2024 -0800
Remove default admin credentials (#1134)
* Remove default admin credentials
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Replace default password with a placeholder in README files
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 97482c19b0eded34a7f435e589303a834c258aa3
Author: Jackie Han <hnyng@amazon.com>
Date: Wed Jan 24 09:39:55 2024 -0800
Require JDK version for java spotless check (#1129)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 708e0462189677a217b35905c2feba5486c77cdc
Author: Andriy Redko <andriy.redko@aiven.io>
Date: Tue Jan 23 15:11:39 2024 -0500
Update to Jackson 2.16.1 (#1135)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
commit 7c0ce4cb554a05230ecf5365b903219f357997bf
Author: Andriy Redko <drreta@gmail.com>
Date: Tue Jan 16 17:51:37 2024 -0500
Update to Gradle 8.5 (#1131)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
commit e5cbe93c0e9cadebe2a30cba83f99ae8a3f8fe57
Author: zane-neo <zaniu@amazon.com>
Date: Thu Jan 4 16:50:47 2024 +0800
add publishToMavenLocal task to fix zip plugin not pulished to maven local issue when running this script (#1121)
Signed-off-by: zane-neo <zaniu@amazon.com>
commit 106dc25b3ef36beae329dc7882bcdf9c23347fb5
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Dec 27 16:33:25 2023 -0800
Refactor client's getDetectorProfile to use GetAnomalyDetectorTransportAction (#1124)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 59b4ebecfa11cac977f49c999ce85637fb6fac58
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Dec 27 11:56:00 2023 -0800
Add profile transport action to AD client (#1119)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 29711f96dbb2c9abc1181b933a8b334eed63ca66
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Tue Dec 12 08:32:53 2023 -0800
Add an AD transport client (#1110)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 353dcaeb05f8b75fa74d92e2ae8415ab018bc68e
Author: Daniel Widdis <widdis@gmail.com>
Date: Wed Nov 22 13:59:53 2023 -0800
Fix build, update CVE-affected versions (#1102)
* Fix build, update CVE-affected versions
Signed-off-by: Daniel Widdis <widdis@gmail.com>
* Spotless depends on CVE-impacted eclipse dependency, now needs JDK17+
Signed-off-by: Daniel Widdis <widdis@gmail.com>
---------
Signed-off-by: Daniel Widdis <widdis@gmail.com>
commit 4c6ba48bf9fb9234ad8bc0b9193f3c68409acfb9
Author: Peter Zhu <zhujiaxi@amazon.com>
Date: Mon Oct 30 19:35:01 2023 -0400
Fix the bwc test version retrieval (#1093)
* Onboarding jenkins prod docker images to github actions
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
---------
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
commit a1da3aa0eefc6671446d2eb3bc670bad6449d2f0
Author: Peter Zhu <zhujiaxi@amazon.com>
Date: Mon Oct 30 19:14:31 2023 -0400
Onboarding jenkins prod docker images to github actions (#1092)
* Onboarding jenkins prod docker images to github actions
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
---------
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
commit 040cd7e33f8e696ffe7748140c9b0ecc7475d513
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:43:02 2023 -0700
dependabot: bump net.bytebuddy:byte-buddy from 1.14.6 to 1.14.9 (#1081)
Bumps [net.bytebuddy:byte-buddy](https://github.com/raphw/byte-buddy) from 1.14.6 to 1.14.9.
- [Release notes](https://github.com/raphw/byte-buddy/releases)
- [Changelog](https://github.com/raphw/byte-buddy/blob/master/release-notes.md)
- [Commits](https://github.com/raphw/byte-buddy/compare/byte-buddy-1.14.6...byte-buddy-1.14.9)
---
updated-dependencies:
- dependency-name: net.bytebuddy:byte-buddy
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit dd9c1521bc1946027245d65e39a7844cdf04a8b7
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:42:15 2023 -0700
dependabot: bump aws-actions/configure-aws-credentials (#1076)
Bumps [aws-actions/configure-aws-credentials](https://github.com/aws-actions/configure-aws-credentials) from 1.7.0 to 4.0.1.
- [Release notes](https://github.com/aws-actions/configure-aws-credentials/releases)
- [Changelog](https://github.com/aws-actions/configure-aws-credentials/blob/main/CHANGELOG.md)
- [Commits](https://github.com/aws-actions/configure-aws-credentials/compare/v1.7.0...v4.0.1)
---
updated-dependencies:
- dependency-name: aws-actions/configure-aws-credentials
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit d6e3fd7a69b1daea45d7a455335e55b6de118033
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:05:00 2023 -0700
dependabot: bump com.netflix.nebula.ospackage from 11.0.0 to 11.5.0 (#1066)
Bumps com.netflix.nebula.ospackage from 11.0.0 to 11.5.0.
---
updated-dependencies:
- dependency-name: com.netflix.nebula.ospackage
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 57eacf611ce44559e14aa37f2e51dfbb82d53cc2
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:04:19 2023 -0700
dependabot: bump org.apiguardian:apiguardian-api from 1.1.0 to 1.1.2 (#1058)
Bumps [org.apiguardian:apiguardian-api](https://github.com/apiguardian-team/apiguardian) from 1.1.0 to 1.1.2.
- [Release notes](https://github.com/apiguardian-team/apiguardian/releases)
- [Commits](https://github.com/apiguardian-team/apiguardian/compare/r1.1.0...r1.1.2)
---
updated-dependencies:
- dependency-name: org.apiguardian:apiguardian-api
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 6b9faf2b71e5481be366b12bd6f16440c6c8ef89
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:04:01 2023 -0700
dependabot: bump org.junit.platform:junit-platform-launcher (#1056)
Bumps [org.junit.platform:junit-platform-launcher](https://github.com/junit-team/junit5) from 1.9.2 to 1.10.0.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/commits)
---
updated-dependencies:
- dependency-name: org.junit.platform:junit-platform-launcher
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 2a957f2086688b5ee76703406105797d31207cc5
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:03:11 2023 -0700
Bump urllib3 from 1.26.9 to 1.26.17 in /dataGeneration (#1068)
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.9 to 1.26.17.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.9...1.26.17)
---
updated-dependencies:
- dependency-name: urllib3
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit a12e33214f9c138946975801cefa2bd39c7978a9
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 11:29:37 2023 -0700
dependabot: bump org.objenesis:objenesis from 3.0.1 to 3.3 (#1040)
Bumps [org.objenesis:objenesis](https://github.com/easymock/objenesis) from 3.0.1 to 3.3.
- [Release notes](https://github.com/easymock/objenesis/releases)
- [Commits](https://github.com/easymock/objenesis/compare/3.0.1...3.3)
---
updated-dependencies:
- dependency-name: org.objenesis:objenesis
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 5a4ba14a431fbc53f757416542cda25ef2fae58c
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 11:28:46 2023 -0700
dependabot: bump tibdex/github-app-token from 2.0.0 to 2.1.0 (#1065)
Bumps [tibdex/github-app-token](https://github.com/tibdex/github-app-token) from 2.0.0 to 2.1.0.
- [Release notes](https://github.com/tibdex/github-app-token/releases)
- [Commits](https://github.com/tibdex/github-app-token/compare/v2.0.0...v2.1.0)
---
updated-dependencies:
- dependency-name: tibdex/github-app-token
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 713d556d980ccb144eb6ae952cebc7b3963ed28c
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 15:05:44 2023 -0700
dependabot: bump actions/setup-java from 1 to 3 (#1035)
Bumps [actions/setup-java](https://github.com/actions/setup-java) from 1 to 3.
- [Release notes](https://github.com/actions/setup-java/releases)
- [Commits](https://github.com/actions/setup-java/compare/v1...v3)
---
updated-dependencies:
- dependency-name: actions/setup-java
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 574ac521653ede84e7b821bc3c06049f1054a6ad
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 10:53:02 2023 -0700
dependabot: bump tibdex/github-app-token from 1.5.0 to 2.0.0 (#1042)
Bumps [tibdex/github-app-token](https://github.com/tibdex/github-app-token) from 1.5.0 to 2.0.0.
- [Release notes](https://github.com/tibdex/github-app-token/releases)
- [Commits](https://github.com/tibdex/github-app-token/compare/v1.5.0...v2.0.0)
---
updated-dependencies:
- dependency-name: tibdex/github-app-token
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 65e207aef49a6872408ae02e4f49cdd9060c1ef0
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 10:52:40 2023 -0700
dependabot: bump org.apache.commons:commons-pool2 from 2.10.0 to 2.11.1 (#1045)
Bumps org.apache.commons:commons-pool2 from 2.10.0 to 2.11.1.
---
updated-dependencies:
- dependency-name: org.apache.commons:commons-pool2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit a4ff71926af39726d9b4584102706e3ea7f4fa05
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:16:31 2023 -0400
React to Tracer changes in TransportService (#1034)
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 05d0a3b905cae9d25f6d5d91f30f1b842b9a792f
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:14:20 2023 -0400
Ensure integ tests run with security after plugin rename (#1023)
* Ensure integ tests run with security after plugin rename
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Rename to time-series-analytics
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Switch folder back
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Run integTest with -i
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Remove opensearch-anomaly-detection if installed
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update password rules and change expected error msg
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update password generation
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Fix indexOf condition
Signed-off-by: Craig Perkins <cwperx@amazon.com>
---------
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 72210f014ab54bf4a5b567ebe9dabe13b66c6cbb
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:39 2023 -0700
dependabot: bump codecov/codecov-action from 1 to 3 (#1038)
Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 1 to 3.
- [Release notes](https://github.com/codecov/codecov-action/releases)
- [Changelog](https://github.com/codecov/codecov-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/codecov/codecov-action/compare/v1...v3)
---
updated-dependencies:
- dependency-name: codecov/codecov-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit b77c3a7406e94424550ec1f22f084bc20533994f
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:14 2023 -0700
dependabot: bump com.google.guava:guava from 32.0.1-jre to 32.1.2-jre (#1037)
Bumps [com.google.guava:guava](https://github.com/google/guava) from 32.0.1-jre to 32.1.2-jre.
- [Release notes](https://github.com/google/guava/releases)
- [Commits](https://github.com/google/guava/commits)
---
updated-dependencies:
- dependency-name: com.google.guava:guava
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 18defcc16e81abe590e8f109d6df3c4a060f74ce
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:03 2023 -0700
dependabot: bump VachaShah/backport from 1.1.4 to 2.2.0 (#1039)
Bumps [VachaShah/backport](https://github.com/vachashah/backport) from 1.1.4 to 2.2.0.
- [Release notes](https://github.com/vachashah/backport/releases)
- [Changelog](https://github.com/VachaShah/backport/blob/main/CHANGELOG.md)
- [Commits](https://github.com/vachashah/backport/compare/v1.1.4...v2.2.0)
---
updated-dependencies:
- dependency-name: VachaShah/backport
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 726759f104117e1a28648a1524cdface49168b79
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:53 2023 -0700
dependabot: bump actions/checkout from 2 to 4 (#1041)
Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v2...v4)
---
updated-dependencies:
- dependency-name: actions/checkout
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit f6ac01886a662264323d1e11a2199fb190148c80
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:38 2023 -0700
dependabot: bump org.jacoco:org.jacoco.ant from 0.8.5 to 0.8.10 (#1044)
Bumps [org.jacoco:org.jacoco.ant](https://github.com/jacoco/jacoco) from 0.8.5 to 0.8.10.
- [Release notes](https://github.com/jacoco/jacoco/releases)
- [Commits](https://github.com/jacoco/jacoco/compare/v0.8.5...v0.8.10)
---
updated-dependencies:
- dependency-name: org.jacoco:org.jacoco.ant
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit d30bcc394e6f281b6de504f102a0085ae56e78e4
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:22 2023 -0700
dependabot: bump org.junit.jupiter:junit-jupiter-api (#1043)
Bumps [org.junit.jupiter:junit-jupiter-api](https://github.com/junit-team/junit5) from 5.9.2 to 5.10.0.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/compare/r5.9.2...r5.10.0)
---
updated-dependencies:
- dependency-name: org.junit.jupiter:junit-jupiter-api
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 92256db92f9ed78cb1de9925297c9ff5cce6da74
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:04:23 2023 -0400
Add dependabot.yml (#1026)
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 23611f6d8ccdc9a4c41469ec0a4746290f976b4f
Author: Jackie Han <hnyng@amazon.com>
Date: Fri Sep 8 11:19:31 2023 -0700
Add 2.10 release notes (#1031)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit ee1db57058e08c36e4820637973f18016cf45015
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Wed Sep 6 16:55:00 2023 -0700
Updates demo certs for integ tests (#1018)
Signed-off-by: Owais Kazi <owaiskazi19@gmail.com>
commit 338d72eb692c81802a70fe42556cde70c01cad6a
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Sep 6 16:08:01 2023 -0700
refactor job response (#1017)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit db456c2543a6f1ff6b77db10bd19952768d16182
Author: Jackie Han <hnyng@amazon.com>
Date: Tue Sep 5 15:47:50 2023 -0700
upgrading commons-lang3 version to fix conflict issue (#1012)
* force commons-lang3 version to fix conflict issue
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from upstream version properties file
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* upgrading commons-lang3 version to align with core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit db788f4714233121eba4238869b8db89ae0037d4
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Tue Sep 5 13:58:31 2023 -0700
Adds auto release workflow (#1003)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 327c141e9b70465b1760f9ebf8c001a2e439b01f
Author: Jackie Han <hnyng@amazon.com>
Date: Fri Sep 1 13:00:23 2023 -0700
Revert "Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards (#948)" (#999)
This reverts commit bc1649922ef39619424fc16c64af5836e48a4a12.
commit 4a09b741e1c127a92775cb55f4c56aa5c4f3f6a3
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Aug 21 11:21:36 2023 -0700
Update Gradle Wrapper to 8.2.1 for Enhanced JDK20 Compatibility (#985)
- **Reason for Upgrade**: The migration to JDK20 ([reference](https://github.com/opensearch-project/opensearch-build/blob/aa65a8ecd69f77c3d3104043dd1c48dff708bffa/manifests/3.0.0/opensearch-3.0.0.yml#L9)) rendered the current Gradle version (7.6.1) incompatible.
- **Actions Taken**:
- **Gradle Wrapper Update**: Upgraded the Gradle wrapper to version 8.2.1 to maintain compatibility with JDK20. The gradle wrapper files are generated using the `./gradlew wrapper` command.
- Applied `spotless` due to new formatting requirements in Gradle 8.
- Resolved test "jar hell" issues. Gradle 8 introduced internal JARs to the test classpath that conflicted with dependencies from `org.junit.vintage:junit-vintage-engine`. As a remedy, these conflicting JARs have been excluded.
- **Relevant Pull Requests**:
- [Alerting#893](https://github.com/opensearch-project/alerting/pull/893/files)
- [ML-Commons#892](https://github.com/opensearch-project/ml-commons/pull/892)
- [Security PR](https://github.com/opensearch-project/security/pull/2978)
- **Verification**: Successfully verified the changes using `gradle build`.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 5ac6390e7de643d8177f0a5833995032f3a279ad
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Aug 17 11:08:36 2023 -0700
Refactoring task cache manager for forecasting (#982)
* Refactoring Shared Functionality for Broader Task Compatibility
This PR extracts shared components from `ADTaskCacheManager` into `TaskCacheManager` to support the requirements of the forecasting feature.
**Renamings**:
- **Method-level in `ADTaskCacheManager`**:
- `addDeletedDetector` to `addDeletedConfig`
- `addDeletedDetectorTask` to `addDeletedTask`
- `hasDeletedDetectorTask` to `hasDeletedTask`
- `pollDeletedDetector` to `pollDeletedConfig`
- `pollDeletedDetectorTask` to `pollDeletedTask`
- **Variable-level in `AnomalyDetectorSettings`**:
- `CHECKPOINT_MAINTAIN_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_MAINTAIN_QUEUE_MAX_HEAP_PERCENT`
- `CHECKPOINT_READ_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_READ_QUEUE_MAX_HEAP_PERCENT`
- `CHECKPOINT_SAVING_FREQ` to `AD_CHECKPOINT_SAVING_FREQ`
- `CHECKPOINT_TTL` to `AD_CHECKPOINT_TTL`
- `CHECKPOINT_WRITE_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_WRITE_QUEUE_MAX_HEAP_PERCENT`
- `COLD_ENTITY_QUEUE_MAX_HEAP_PERCENT` to `AD_COLD_ENTITY_QUEUE_MAX_HEAP_PERCENT`
- `DEDICATED_CACHE_SIZE` to `AD_DEDICATED_CACHE_SIZE`
- `ENTITY_COLD_START_QUEUE_CONCURRENCY` to `AD_ENTITY_COLD_START_QUEUE_CONCURRENCY`
- `ENTITY_COLD_START_QUEUE_MAX_HEAP_PERCENT` to `AD_ENTITY_COLD_START_QUEUE_MAX_HEAP_PERCENT`
- `EXPECTED_COLD_ENTITY_EXECUTION_TIME_IN_MILLISECS` to `AD_EXPECTED_COLD_ENTITY_EXECUTION_TIME_IN_MILLISECS`
- `FILTER_BY_BACKEND_ROLES` to `AD_FILTER_BY_BACKEND_ROLES`
- `MAX_ENTITIES_PER_QUERY` to `AD_MAX_ENTITIES_PER_QUERY`
- `MAX_MODEL_SIZE_PER_NODE` to `AD_MAX_MODEL_SIZE_PER_NODE`
- `MAX_MULTI_ENTITY_ANOMALY_DETECTORS` to `AD_MAX_HC_ANOMALY_DETECTORS`
- `MAX_RETRY_FOR_END_RUN_EXCEPTION` to `AD_MAX_RETRY_FOR_END_RUN_EXCEPTION`
- `MAX_SINGLE_ENTITY_ANOMALY_DETECTORS` to `AD_MAX_SINGLE_ENTITY_ANOMALY_DETECTORS`
- `MODEL_MAX_SIZE_PERCENTAGE` to `AD_MODEL_MAX_SIZE_PERCENTAGE`
- `PAGE_SIZE` to `AD_PAGE_SIZE`
- `RESULT_WRITE_QUEUE_MAX_HEAP_PERCENT` to `AD_RESULT_WRITE_QUEUE_MAX_HEAP_PERCENT`
- **Class-level**:
- `ADRealtimeTaskCache` renamed to `RealtimeTaskCache`
- **Package-level**:
- Shifted from `org.opensearch.ad.breaker` to `org.opensearch.timeseries.breaker`
**Migrations**:
- Variables transferred from `AnomalyDetectorSettings` to `TimeSeriesSettings`:
- `BATCH_BOUNDING_BOX_CACHE_RATIO`
- `CHECKPOINT_MAINTAIN_REQUEST_SIZE_IN_BYTES`
- `CHECKPOINT_WRITE_QUEUE_SIZE_IN_BYTES`
- `DEFAULT_AD_JOB_LOC_DURATION_SECONDS` (renamed to `DEFAULT_JOB_LOC_DURATION_SECONDS`)
- `ENTITY_REQUEST_SIZE_IN_BYTES`
- `HOURLY_MAINTENANCE`
- `INTERVAL_RATIO_FOR_REQUESTS`
- `LOW_SEGMENT_PRUNE_RATIO`
- `MAINTENANCE_FREQ_CONSTANT`
- `MAX_COLD_START_ROUNDS`
- `MAX_QUEUED_TASKS_RATIO`
- `MAX_TOTAL_RCF_SERIALIZATION_BUFFERS`
- `MAX_CHECKPOINT_BYTES`
- `MEDIUM_SEGMENT_PRUNE_RATIO`
- `NUM_MIN_SAMPLES`
- `NUM_SAMPLES_PER_TREE`
- `NUM_TREES`
- `QUEUE_MAINTENANCE`
- `RESULT_WRITE_QUEUE_SIZE_IN_BYTES`
- `SERIALIZATION_BUFFER_BYTES`
- `THRESHOLD_MIN_PVALUE`
- `TIME_DECAY`
**Deletions**:
- Obsolete settings and methods:
- `DESIRED_MODEL_SIZE_PERCENTAGE` in `AnomalyDetectorSettings`
- `getDesiredModelSize` in `MemoryTracker`
**Modifications**:
- `MemoryTracker` enums renamed for clear differentiation between real-time and historical memory usage, adding `REAL_TIME_FORECASTER` for a harmonized single-stream and HC analysis approach.
**Tests**:
- Changes validated with a successful Gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 0c5b4b94cb5b192160463fa8a5f58eac587fe95d
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Aug 15 13:09:17 2023 -0700
Update RCF to v3.8 and Enable Auto AD with 'Alert Once' Option (#979)
* Update RCF to v3.8 and Enable Auto AD with 'Alert Once' Option
This PR added support for automatic Anomaly Detection (AD) and the 'Alert Once' option introduced in RCF 3.8.
Testing done:
1. Deserialization Test:
* Verified model deserialization from 3.0-rc3.
* Ensured consistent scoring using the rc3 checkpoint and rc3 dependency on identical data.
2. Backward Compatibility Test:
* Executed a mixed cluster with versions 2.10 and 3.0.
* Validated that older detectors still produce results without throwing any exceptions in a blue-green simulation scenario.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* reduce recall since alertOnce reduced recall
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* remove commented out code
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit cadc9bbd949daf4f2669335bfb8629e2137c108d
Author: Joshua Palis <jpalis@amazon.com>
Date: Fri Aug 11 16:02:38 2023 -0700
Fixing imports, adding TermsAggregator BucketCountThresholds for StringTerms, setting AnomalyResult grade to 0 if negative value (#976)
Signed-off-by: Joshua Palis <jpalis@amazon.com>
commit 3985cd2f82f2cfa57604ecf5a512bb042e632cae
Author: Romain Tartière <romain@blogreen.org>
Date: Wed Aug 9 08:59:30 2023 -1000
Fix build with latest OpenSearch (for real this time) (#972)
This is a follow-up to #971, where commit
2839bc2c6f470639b68901086c80cb2152d96558 only fixed _some_ but not _all_
of the build errors (it allowed `./gradlew run` to pass but `./gradlew
build` was failing).
Fix the build errors when we run `./gradlew build`.
Signed-off-by: Romain Tartière <romain@blogreen.org>
commit 2839bc2c6f470639b68901086c80cb2152d96558
Author: Romain Tartière <romain@blogreen.org>
Date: Tue Aug 8 13:15:04 2023 -1000
Fix build with latest OpenSearch (#971)
OpenSearch recently merged some code that cause buid failure for this
module, as spotted in #585.
This change the import to match the new one after
https://github.com/opensearch-project/OpenSearch/pull/9103
Signed-off-by: Romain Tartière <romain@blogreen.org>
commit d4946f04e7ad44f0bc79215962c6678786c592ff
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Aug 7 14:21:56 2023 -0700
Refactor ADTask and Related Components (#969)
* Refactor ADTask and Related Components
This PR includes several key refactoring changes:
- Extracts common code from ADTask into TimeSeriesTask, creating ForecastTask for forecasting-specific logic.
- Consolidates common code from ADTaskType into TaskType and introduces ForecastTaskType for forecasting-related purposes.
- Renames ADTaskState to TaskState for consistent code reuse.
- Renames the method getId in ADTask to getConfigId to differentiate it from other IDs like task id.
Testing done:
1. Added unit tests for the new code to ensure functionality.
2. Executed a successful Gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* add comments and address compiler errors
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Amit's comments and address compiler failure
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 1130a1ba6fc3c08f375dd99f98e93e4ee36331fb
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jul 27 10:39:39 2023 -0700
Refactoring NodeStateManager etc. to support forecasting functionality (#965)
* Refactoring NodeStateManager etc. to support forecasting functionality
This commit extends the codebase to support both Anomaly Detection (AD) and forecasting. It contains a mixture of refactoring, renaming, removal of unused code, and package moving tasks. Here are the details:
Refactoring:
- `NodeStateManager.getAnomalyDetector` is now `getConfig`, with added functionality to fetch a Forecaster. The method comments are updated for clarity.
- Existing methods (`getFeatureSamplesForPeriods`, `getColdStartSamplesForPeriods`, `createPreviewSearchRequest`, `getMinDataTime`) have been added in `SearchFeatureDao` to handle forecasting logic.
- Adjusted `SecurityClientUtil` and `ParseUtils` to handle forecasting logic.
- Cleaned up `NodeState` to differentiate state for AD and forecasting.
Renaming:
- `AnomalyDetectorJob` is renamed to `Job` to facilitate reuse for forecasting.
- `NodeStateManager.getAnomalyDetectorJob` is renamed to `getJob`.
- Certain settings in `AnomalyDetectorSettings` are renamed to reflect they are meant for the AD setting. They have been marked as deprecated and new settings are used in `TimeSeriesSettings` instead.
- `IndexAnomalyDetectorJobActionHandler.getAnomalyDetectorJobForWrite` is renamed to `getJobForWrite`.
- `ADSafeSecurityInjector` is renamed to `TimeSeriesSafeSecurityInjector`.
Removing unused code:
- Synchronous code in `ClientUtil`, `IndexUtils`, and `CheckpointDao` is removed.
- The unused class `Throttler` is deleted.
- Mapping file names are changed, and the code referencing these files is adjusted.
Package moving:
- Several classes (`ClientUtil`, `MultiResponsesDelegateActionListener`, `SafeSecurityInjector`, `SecurityUtil`, `ExceptionUtil`, `SearchFeatureDao`, `CleanState`, `ExpiringState`, `MaintenanceState`, `NodeState`, `SingleStreamModelIdMapper`, `BackPressureRouting`) are moved to the respective `org.opensearch.timeseries` packages.
Miscellaneous:
- Fixed compiler failures caused by changes in https://github.com/opensearch-project/OpenSearch/pull/8730 by replacing `DoubleArrayList` with `java.util.ArrayList`.
- Updates the Backwards Compatibility (bwc) version to align with the core's incremented bwc version as per [OpenSearch PR #8670](https://github.com/opensearch-project/OpenSearch/pull/8670). This change prevents the issue described in [OpenSearch Issue #5076](https://github.com/opensearch-project/OpenSearch/issues/5076).
Testing:
- Executed a `gradle build`.
- Added new tests for `ClientUtil` and `NodeStateManager`.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comment
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* fix compiler error and comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit f0ed43b1aa3c5d80dc6f23a5dd4465bb03ef1739
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jul 17 15:18:03 2023 -0700
Rename AD to time series analytics & Resolve Compiler Errors (#951)
This commit focuses on renaming the AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin as well as addressing compiler errors due to package import changes. The primary transformations are:
* Renamed AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin.
* Updated all references from AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin.
* Amended plugin information in build.gradle and src/main/resources/es-plugin.properties.
* Switched job type in TimeSeriesAnalyticsPlugin from opendistro_anomaly_detector to opensearch_time_series_analytics.
These changes led to the modification of our plugin binary from opensearch-anomaly-detection-3.0.0.0-SNAPSHOT.jar to opensearch-time-series-analytics-3.0.0.0-SNAPSHOT.jar.
Moreover, following changes from OpenSearch Pull Request #8157, compiler errors were encountered, which were resolved by updating the import packages
* org.opensearch.common.io.stream.NamedWriteableRegistry => org.opensearch.core.common.io.stream.NamedWriteableRegistry
* org.opensearch.common.xcontent.XContentParserUtils => * org.opensearch.core.xcontent.XContentParserUtils
* org.opensearch.common.bytes.BytesArray => org.opensearch.core.common.bytes.BytesArray * org.opensearch.common.io.stream.StreamInput => * org.opensearch.core.common.io.stream.StreamInput ** org.opensearch.common.io.stream.StreamOutput => org.opensearch.core.common.io.stream.StreamOutput
* org.opensearch.common.io.stream.Writeable => org.opensearch.core.common.io.stream.Writeable
* org.opensearch.common.io.stream.NotSerializableExceptionWrapper => org.opensearch.core.common.io.stream.NotSerializableExceptionWrapper
* org.opensearch.rest.RestStatus => org.opensearch.core.rest.RestStatus
* org.opensearch.common.ParsingException => org.opensearch.core.common.ParsingException
* org.opensearch.common.bytes.BytesReference => org.opensearch.core.common.bytes.BytesReference
* org.opensearch.common.io.stream.InputStreamStreamInput => org.opensearch.core.common.io.stream.InputStreamStreamInput
* org.opensearch.common.io.stream.OutputStreamStreamOutput => org.opensearch.core.common.io.stream.OutputStreamStreamOutput
* org.opensearch.index.shard.ShardId => org.opensearch.core.index.shard.ShardId* org.opensearch.index.Index => org.opensearch.core.index.Index
* org.opensearch.core.index.IndexNotFoundException => org.opensearch.index.IndexNotFoundException
Validation steps were executed to ensure these changes did not break functionality:
* gradle build was successful. A local build was required due to outdated OpenSearch and job scheduler nightly builds.
* Backward compatibility tests were performed on a two-node 2.9 cluster running some detectors. These detectors continued to produce results on a 3.0 cluster with these updates.
* I can start new detectors on the 3.0 node.
* After shutting down a 2.9 node, the job transfer to the 3.0 node was successful and the job continued to perform as expected.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit c7c6a46e88e15f615fc9dae0499cf0d674662057
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Thu Jul 13 15:42:46 2023 -0700
Add 2.9 release notes (#952)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit bc1649922ef39619424fc16c64af5836e48a4a12
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Jul 11 13:34:09 2023 -0700
Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards (#948)
* Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards
In this PR, we temporarily enforce DOCUMENT replication for AD indices. This change is necessary due to the current limitation of SegRep, which doesn't support Get/MultiGet by ID. This measure will be in place until SegRep adds support for these operations.
This adjustment aligns with the modification made in the referenced PR: job-scheduler PR #417
Additionally, this PR increases the number of primary shards for forecasting indices from 10 to 20, recognizing the higher write intensity of these indices. For instance, when the horizon is 24, we are expected to save 25 documents: 24 for each forecast and 1 for the actual value. In contrast, for AD, we save one document per actual value.
Testing done:
1. gradle build passed
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Fix comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit a1203827617ee42b35d41cb8b010719f334f73b7
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jul 10 10:53:17 2023 -0700
Add ForecastResult and Refactor Shared Code (#941)
This commit adds the functionality of ForecastResult, while also performing several necessary refactorings.
Firstly, we introduce ForecastResult, which closely mirrors the functionality of AnomalyResult. Any shared code between these two classes has been abstracted out into a new parent class, IndexableResult. This refactoring was undertaken to facilitate code reuse and improve maintainability, as both classes deal with storing fields that need to be saved in result indices.
Secondly, we've also extracted common code from ThresholdingResult into another new class, IntermediateResult. This work is in preparation for a forthcoming PR which will introduce RCFCasterResult. In this change, we moved the 'toAnomalyResult' method to IndexableResult, and renamed it to 'toIndexableResults'. This renaming allows for reuse in the upcoming RCFCasterResult. The updated method now returns a list of results instead of a single result. The shift caters for the RCFCasterResult use case where one RCFCasterResult is stored across multiple ForecastResult documents.
Furthermore, this commit modifies the 'entity' field in several methods to be of the Optional type, indicating that it can be empty. This change provides a clear signal to other developers about the optional nature of these fields.
In addition, this commit updates the mapping for the forecast result index. The prior mapping was a placeholder and this change brings it up to date.
We've also moved to using httpcore5 and httpclient5 versions from OpenSearch core, as necessitated by recent changes in [OpenSearch PR #8434](https://github.com/opensearch-project/OpenSearch/pull/8434/files). This shift resolves potential jar hell issues with httpcore5 and httpclient5.
Lastly, we've made name and package changes:
1. Renamed 'initDetectionStateIndex' in ADIndexManagement to 'initStateIndex' to align with ForecastIndexManagement naming.
2. Moved the 'DataByFeatureId' class to the 'timeseries' package for better organization.
This commit also completes the 'createDummyIndexRequest' method in ForecastIndexManagement by invoking 'ForecastResult.getDummyResult()', which is now possible due to the introduction of the ForecastResult implementation.
Testing done:
1. added tests for new code
2. gralde build passes
3. e2e tests
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit f24d9e32ff739abf29cac3da15fd00f74219e213
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Thu Jul 6 17:28:09 2023 -0700
Bump scipy from 1.8.0 to 1.10.0 in /dataGeneration (#943)
Bumps [scipy](https://github.com/scipy/scipy) from 1.8.0 to 1.10.0.
- [Release notes](https://github.com/scipy/scipy/releases)
- [Commits](https://github.com/scipy/scipy/compare/v1.8.0...v1.10.0)
---
updated-dependencies:
- dependency-name: scipy
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 9b9fd2ba3f3e678d717c0a45af8069bb67828808
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Jun 27 16:08:55 2023 -0700
bump guava version to 32.0.1 (#933)
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit 99749dfa6bfc8a2f2c4660ca01d75d1ad57124a5
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jun 26 16:46:24 2023 -0700
Refactoring Index Creation for Improved Code Reuse and Consistency (#932)
This Pull Request significantly refactors the index creation module to promote greater code reusability and consistency. The primary changes are outlined as follows:
1. Code Migration: Common code segments have been moved from AnomalyDetectionIndices to IndexManagement. In addition, component-specific code has been established in ADIndexManagement and ForecastIndexManagement. The bulk of changes are concentrated in these three classes, with the remainder of the modifications relating to reference/test changes.
2. Function Renaming: Several functions have been renamed for broader applicability and consistency:
* AnomalyDetectorFunction has been renamed to ExecutorFunction for potential use in Forecasting.
* AnomalyDetectorSettings.MAX_PRIMARY_SHARDS has been renamed to AnomalyDetectorSettings.AD_MAX_PRIMARY_SHARDS in light of the new ForecastSettings.FORECAST_MAX_PRIMARY_SHARDS.
* doesAnomalyDetectorJobIndexExist() has been renamed to doesJobIndexExist() to allow for job index reusability across Anomaly Detection (AD) and forecasting. Analogous changes have been made to other job index-related functions.
* doesAnomalyDetectorIndexExist() has been renamed to doesConfigIndexExist() to allow for config index reusability across AD and forecasting. Analogous changes have been made to other config index-related functions.
* detectionIndices.doesDetectorStateIndexExist() has been renamed to detectionIndices.doesStateIndexExist(), as the former name was unnecessarily redundant. Similar modifications have been made to the result and checkpoint index.
3. Class Migration: The classes ThrowingSupplierWrapper, ThrowingConsumer, and ThrowingSupplier have been moved from org.opensearch.ad.util to org.opensearch.timeseries.function to promote code reuse.
4. Initial Forecast Indices' Mapping: An initial version of forecast indices' mapping has been added, which can be adjusted as required in the future.
5. In terms of version updates, 2.x has been bumped to 2.9, prompting an increment of the Backward Compatibility (BWC) test version to 2.9.
6. Update dependency com.google.guava:guava to v32 for cve fix.
Testing done:
Testing has been performed with new tests added for forecast index creation, and the grade build passes successfully.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit aedb781a6b1df984636d72d50b65d41138539918
Author: Craig Perkins <craig5008@gmail.com>
Date: Tue Jun 20 16:55:19 2023 -0400
Fix main build - update import of Releasable and remove reference to BaseExceptionsHelper (#930)
* Fix main build - update import of Releasable and remove reference to BaseExceptionsHelper
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update imports in test classes
Signed-off-by: Craig Perkins <cwperx@amazon.com>
---------
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit fce78c29c0375ae06f56e16c85fb98933401e28f
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Jun 14 10:36:40 2023 -0700
Refactor: Reorganize code for Forecasting and AnomalyDetector packages (#925)
* Refactor: Reorganize code for Forecasting and AnomalyDetector packages
This PR includes several refactorings to increase code reuse and improve readability:
1. Entity, FeatureData, and RestHandlerUtils have been moved from the 'ad' package to the 'timeseries' package, enabling their use within the Forecasting code.
2. A new class, DataByFeatureId, has been created to hold shared code previously located in FeatureData. FeatureData now inherits from DataByFeatureId. The standalone usage of DataByFeatureId will be detailed in subsequent PRs.
3. Renamed checkAnomalyDetectorFeaturesSyntax to checkFeaturesSyntax in RestHandlerUtils to make it more generic and usable for Forecasting.
4. Constants AGG_NAME_MAX_TIME, AGG_NAME_MIN_TIME, DATE_HISTOGRAM, and FEATURE_AGGS have been moved from ADCommonName to CommonName to make them accessible for Forecasting.
5. A new method, parseConfig, has been added to the Config class. This method can parse configuration for either AnomalyDetector or Forecaster based on input.
Testing:
The changes have been validated with a successful gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Amit and Owais's comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 02c120f025f73f3d45a8477c7ef8b4873befebfa
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jun 12 11:54:39 2023 -0700
Updated Maintainers and CODE_OWNERS list (#926)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 2ea4dcf430b40a710a0babb04881eeff9fb2d689
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jun 8 15:11:44 2023 -0700
Add Forecaster class (#920)
* Add Forecaster class
This PR adds class Forecaster that serves as the configuration POJO for forecasting. Shared code between AnomalyDetector and Forecaster is extracted and moved to the Config class to reduce duplication and promote reusability. References to the common code in related classes have also been adjusted.
Testing done:
1. gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* fix compiler error due to a recent core change
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Sudipto and Amit's comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit ee04225349a5f0f003d56e77a3243386f4a9673d
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri Jun 2 15:42:19 2023 -0700
Refactor: Migrate files from 'ad' to 'timeseries' package (#918)
* Refactor: Migrate files from 'ad' to 'timeseries' package
This commit involves moving various files from the 'ad' package to the 'timeseries' package. All changes to dependent imports were handled automatically through the IDE, and no changes to file contents were made in the process.
Testing done:
- gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* move ParseUtils to util package
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 472868d165c2234eece8827584f64086aaf7ae92
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jun 1 11:17:16 2023 -0700
Refactor Shared Settings, Introduce Dynamic Forecast Settings, Rename (#912)
* Refactor Shared Settings, Introduce Dynamic Forecast Settings, and Rename Checkpoint mapping File
This commit has undertaken three changes:
* Refactoring of Shared Settings: I've performed a refactoring to unify the settings that are shared between the AD and forecasting modules.
* Introduction of Dynamic Forecast Settings: To increase the adaptability of our system, I've implemented dynamic forecast settings. These settings mirror the existing structure of the AD dynamic settings and will enable us to adjust forecast settings on-the-fly.
* Renaming of Checkpoint File: To enhance the consistency across our AD mapping files, I've renamed checkpoint.json to anomaly-checkpoint.java.
Testing done:
1. added tests for new settings.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* name change and delete files
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 04ab91e60e9d71765a7b9df10b86e0e53ba4d715
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 31 12:18:54 2023 -0700
add 2.8 release notes (#915)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 98da8dffe8d336793ae35658015650b0f83aeef1
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 24 14:37:38 2023 -0700
Implementing Multiple Imputation Methods for Missing Values (#907)
* Implementing Multiple Imputation Methods for Missing Values
This Pull Request introduces multiple imputation methods to handle missing data in Anomaly Detection (AD) and forecasting. The ability to handle missing data is crucial to improve the robustness and accuracy of our models.
The following imputation methods have been implemented:
* Zero Imputation (ZERO): This method replaces all missing values with 0's. It's a simple approach, but it may introduce bias if the data is not centered around zero.
* Fixed Values Imputation (FIXED_VALUES): This method replaces missing values with a predefined set of values. The values are the same for each input dimension, and they need to be specified by the user.
* Previous Value Imputation (PREVIOUS): This method replaces missing values with the last known value in the respective input dimension. It's a commonly used method for time series data, where temporal continuity is expected.
* Linear Interpolation (LINEAR): This method estimates missing values by interpolating linearly between known values in the respective input dimension. This method assumes that the data follows a linear trend.
These methods are designed to provide a set of options for users to handle missing data based on their specific needs and the nature of their data.
Testing Done:
The code changes in this pull request have been validated through a gradle build to ensure that all new and existing tests pass successfully.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Various changes
The commit makes all new files use the shortened header text and addresses compiler/test issues due to core refactoring
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit da608aaa3d3f955efe32b0cb33b3c8cfdd7a7718
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue May 16 11:37:34 2023 -0700
Code Refactoring for CommonMessages (#902)
* Code Refactoring for CommonMessages
In this pull request, I have refactored the code related to shared log or error messages in both AD and forecasting modules to CommonMessages. Additionally, the previously used CommonErrorMessages has been renamed to ADCommonMessages. For the Forecasting module, I have introduced new names in ForecastCommonMessages.
Testing done:
* gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Update string constants wording
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve wording and remove redundant variables
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 041d6ce73d37f1697013b2d2f0683fbfe012247c
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri May 12 13:05:56 2023 -0700
Code Refactoring for CommonName (#901)
In this pull request, I have refactored the code related to shared names in both AD and forecasting modules to CommonNames. Additionally, the previously used CommonName has been renamed to ADCommonName. For the Forecasting module, I have introduced new names in ForecastCommonNames.
Testing done:
* gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit e2fee9d6ba59cc2a23eadbb50a80414fcc7dbf8f
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 10 17:26:31 2023 -0700
Update outdated MAINTAINERS and OWNERS list (#898)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 98b566d1ec57ffd8970b5180c54b493deb1a24ac
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Wed May 10 18:03:04 2023 -0400
Sync up CODEOWNERS with MAINTAINERS.md. (#897)
Signed-off-by: dblock <dblock@amazon.com>
commit 1f8415aa39fa4ec3ba016214255aa0e79b7c7d63
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue May 9 12:55:35 2023 -0700
Various fixes (#886)
* Various fixes
This pull request addresses several issues related to the compiler and tests in the current main branch.
The first major change involves replacing ImmutableOpenMap with java.util.Map in the core. This modification is implemented in the following pull requests:
https://github.com/opensearch-project/OpenSearch/pull/7165
https://github.com/opensearch-project/OpenSearch/pull/7301
To accommodate this change, the codebase of the AD (Anomaly Detection) module has been refactored to utilize JDK maps. As a consequence of this change, passing null to the custom parameters of ClusterState is no longer permissible, as it leads to a NullPointerException. The error stack trace is as follows:
java.lang.NullPointerException: Cannot invoke "Object.getClass()" because "m" is null
at __randomizedtesting.SeedInfo.seed([60CDDB34427ACD0C:6E72DB4ED18E018D]:0)
at java.base/java.util.Collections.unmodifiableMap(Collections.java:1476)
at org.opensearch.cluster.ClusterState.<init>(ClusterState.java:219)
at org.opensearch.ad.transport.DeleteAnomalyDetectorTests.createClusterState(DeleteAnomalyDetectorTests.java:216)
at org.opensearch.ad.transport.DeleteAnomalyDetectorTests.testDeleteADTransportAction_LatestDetectorLevelTask(DeleteAnomalyDetectorTests.java:160)
To address this issue, we have replaced the usage of null with new HashMap<>().
The second change in this pull request aligns with the modifications introduced in PR https://github.com/opensearch-project/anomaly-detection/pull/878.
The third issue is related to the incompatibility between tests that utilize the @Parameters annotation and those that do not, as explained in https://tinyurl.com/2y265s2w. Specifically, the SearchFeatureDaoTests class runes tests with the @Parameters annotation, whereas SearchFeatureDao tests do not.
Testing done:
1. gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 0a48da9e1a0cd70c64cc2da228674baaf377c89e
Author: Jackie Han <hnyng@amazon.com>
Date: Mon Apr 17 12:44:06 2023 -0700
Add 2.7 release notes (#871)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 1edc2ef1ccfe20938711984744b20d1f2ec96a3c
Author: Jackie Han <hnyng@amazon.com>
Date: Tue Apr 11 17:53:57 2023 -0700
Update OpenSearchRejectedExecutionException import (#861)
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update NodeInfo constructor and javadoc for isAdmin method
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit b8df172c2364997c446096e960068d6fc5d2e6f6
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Apr 11 10:55:28 2023 -0700
Giving admin priority over backendrole filtering (#850)
* giving admin priority over backend role filtering
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
* fix security tests
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
* remove redundent line in test case
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
---------
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit fd2fd5d5f63c9004b9f265e3c1e4475282447da8
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Thu Mar 16 14:30:32 2023 -0400
Created untriaged issue workflow. (#809)
Signed-off-by: dblock <dblock@amazon.com>
commit fd547014fdde5114bbc9c8e49fe7aaa37eb6e793
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Mar 1 16:41:05 2023 -0800
Publish snapshots to maven via GHA, fix spotless errors, and bump bwc version (#827)
We are de-coupling the task of publishing the maven snapshots from centralized build workflow to individual repositories. This PR publishes maven snapshots using GitHub Actions.
Testing done:
1. ran ./gradlew publishPluginZipPublicationToSnapshotsRepository according to https://github.com/opensearch-project/anomaly-detection/issues/813
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit b6be5960fb8cff41f0e9d13d5f5a971c289b80ed
Author: Jackie Han <hnyng@amazon.com>
Date: Thu Feb 23 12:23:01 2023 -0800
Update xcontent imports (#822)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 1dcb78a6c4d1331133aefe5af7adf137daa8846f
Author: Jackie Han <hnyng@amazon.com>
Date: Wed Feb 22 11:17:21 2023 -0800
Add 2.6 release note (#818)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 553688aae45590c37cc4d86102642d0b3a6ebb33
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Feb 9 13:38:14 2023 -0800
Revert changes to exception message (#803)
* Revert changes to exception message
We used to log "No RCF models are available either because RCF models are not ready..." and now we log "resource_not_found_exception: No checkpoints found for model id...". This change caused an integration test failure. This PR reverts it back.
Testing done:
1. verified that the original log is back.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* check NO_MODEL_ERR_MSG instead of NO_CHECKPOINT_ERR_MSG
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit c9bdc628a03c4ced3cd1ebeec44ebff792d7ff98
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri Feb 3 11:15:37 2023 -0800
fixing dls/fls logic around numeric aggregations (#801)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 9cebc5bc97a84dd78ac8892863ff7d674428bced
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Jan 10 02:17:04 2023 +0000
adding 2.5 release notes
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit 2ace84643fd199a5e5179e6d21ab76ae212cb7d8
Author: Ryan Bogan <10944539+ryanbogan@users.noreply.github.com>
Date: Tue Jan 10 13:31:49 2023 -0800
Add jackson back to build.gradle (#780)
Signed-off-by: Ryan Bogan <rbogan@amazon.com>
commit a5d60eefab5ac30ef5243da8e7a88b7a2189cd5c
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jan 9 15:49:35 2023 -0800
bump bwc to 2.6.0 (#775)
We need to bump the version because only the latest 2.x will be upgradable to 3.0 when that ship. Since OpenSearch core bumped to 2.6, we need to do that as well. Note after bumping version, bwc still fails to find 2.6.0 core zip.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 27ed49863bfbef90551cdfacc6b51703bf622e25
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jan 9 12:17:57 2023 -0800
Fix the discrepancy between Profile API and real time tasks API (#770)
* Fix the discrepancy between Profile API and real time tasks API
This PR fixes the discrepancy by querying the result index when the total updates is less than 32. We have done similar things in profile API so I refactored reusable code to ProfileUtil. We also cached whether we have queried the result index and won't repeatedly issue the extra query.
Testing done:
1. repeated repro steps in https://github.com/opensearch-project/anomaly-detection/issues/502 and verified the issue has been resolved.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit b49a36b3e7962a205695d451e0497ee4f57fb2cb
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Thu Jan 5 10:19:51 2023 -0800
Updated MAIN…
kaituo
added a commit
to kaituo/anomaly-detection-1
that referenced
this pull request
Mar 27, 2024
commit 30347847cb4ec87f7318587d97054d91c341a312
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Mar 26 13:40:53 2024 -0700
Upgrade rcf to 4.0 (#1173)
This PR upgrades rcf to 4.0 as it has bug fixes and support for streaming imputation mode.
Testing done:
1. gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 8ca1d0d837dd28b6e0820756136eafb8c3ce03ad
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Mar 25 13:44:45 2024 -0700
dependabot: bump actions/checkout from 3 to 4 (#1098)
Bumps [actions/checkout](https://github.com/actions/checkout) from 3 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v3...v4)
---
updated-dependencies:
- dependency-name: actions/checkout
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit d0a2a8ff9fd9640000763c433e05577eea292c48
Author: Darshit Chanpura <35282393+DarshitChanpura@users.noreply.github.com>
Date: Mon Mar 25 16:44:36 2024 -0400
Updates sample cert and admin keystore (#1163)
Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
commit 1921e12b30ac442cd731a5d7a3bdfd3bc31be82b
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Mar 25 13:14:52 2024 -0700
Bump urllib3 from 1.26.17 to 1.26.18 in /dataGeneration (#1090)
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.17 to 1.26.18.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.17...1.26.18)
---
updated-dependencies:
- dependency-name: urllib3
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 8521a76533b533d6887321505c7b5e3d473b02ae
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Mar 25 13:14:18 2024 -0700
dependabot: bump org.apache.commons:commons-pool2 from 2.11.1 to 2.12.0 (#1088)
Bumps org.apache.commons:commons-pool2 from 2.11.1 to 2.12.0.
---
updated-dependencies:
- dependency-name: org.apache.commons:commons-pool2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 303ceb5b320f148dcd015ab6a11f870ae3e23125
Author: Joshua Palis <jpalis@amazon.com>
Date: Mon Mar 18 16:49:59 2024 -0700
Adding 2.13 release notes (#1170)
Signed-off-by: Joshua Palis <jpalis@amazon.com>
commit 1507dd4b4045bd8e8cdf505d07041ce304788ca0
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Feb 21 15:59:34 2024 -0800
Inject NamedWriteableRegistry in AD node client (#1164)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 5b85720d442d1b43001dde0c20248fd4a20a64b0
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Tue Feb 13 10:20:20 2024 -0800
Fixed lucene url (#1158)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 290bdcd832a0cae6d039787d9f0af73ea6be2ec2
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Feb 6 16:14:49 2024 -0800
add 2.12 release notes (#1152)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 6a6eec347379c997f0f7acc88b027bc1ffdd8f54
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Tue Jan 30 18:20:36 2024 -0800
Add ser/deser to get AD transport action request (#1150)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 475f0c36e5b6267aaeb101627b9c3ae1fcca3a88
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Thu Jan 25 14:37:12 2024 -0800
Updated lucene snapshot url (#1146)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 7192d848d2923566a409901909f342a63695e1c2
Author: Jackie Han <hnyng@amazon.com>
Date: Thu Jan 25 09:48:37 2024 -0800
Remove default admin credentials (#1134)
* Remove default admin credentials
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Replace default password with a placeholder in README files
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 97482c19b0eded34a7f435e589303a834c258aa3
Author: Jackie Han <hnyng@amazon.com>
Date: Wed Jan 24 09:39:55 2024 -0800
Require JDK version for java spotless check (#1129)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 708e0462189677a217b35905c2feba5486c77cdc
Author: Andriy Redko <andriy.redko@aiven.io>
Date: Tue Jan 23 15:11:39 2024 -0500
Update to Jackson 2.16.1 (#1135)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
commit 7c0ce4cb554a05230ecf5365b903219f357997bf
Author: Andriy Redko <drreta@gmail.com>
Date: Tue Jan 16 17:51:37 2024 -0500
Update to Gradle 8.5 (#1131)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
commit e5cbe93c0e9cadebe2a30cba83f99ae8a3f8fe57
Author: zane-neo <zaniu@amazon.com>
Date: Thu Jan 4 16:50:47 2024 +0800
add publishToMavenLocal task to fix zip plugin not pulished to maven local issue when running this script (#1121)
Signed-off-by: zane-neo <zaniu@amazon.com>
commit 106dc25b3ef36beae329dc7882bcdf9c23347fb5
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Dec 27 16:33:25 2023 -0800
Refactor client's getDetectorProfile to use GetAnomalyDetectorTransportAction (#1124)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 59b4ebecfa11cac977f49c999ce85637fb6fac58
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Dec 27 11:56:00 2023 -0800
Add profile transport action to AD client (#1119)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 29711f96dbb2c9abc1181b933a8b334eed63ca66
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Tue Dec 12 08:32:53 2023 -0800
Add an AD transport client (#1110)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 353dcaeb05f8b75fa74d92e2ae8415ab018bc68e
Author: Daniel Widdis <widdis@gmail.com>
Date: Wed Nov 22 13:59:53 2023 -0800
Fix build, update CVE-affected versions (#1102)
* Fix build, update CVE-affected versions
Signed-off-by: Daniel Widdis <widdis@gmail.com>
* Spotless depends on CVE-impacted eclipse dependency, now needs JDK17+
Signed-off-by: Daniel Widdis <widdis@gmail.com>
---------
Signed-off-by: Daniel Widdis <widdis@gmail.com>
commit 4c6ba48bf9fb9234ad8bc0b9193f3c68409acfb9
Author: Peter Zhu <zhujiaxi@amazon.com>
Date: Mon Oct 30 19:35:01 2023 -0400
Fix the bwc test version retrieval (#1093)
* Onboarding jenkins prod docker images to github actions
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
---------
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
commit a1da3aa0eefc6671446d2eb3bc670bad6449d2f0
Author: Peter Zhu <zhujiaxi@amazon.com>
Date: Mon Oct 30 19:14:31 2023 -0400
Onboarding jenkins prod docker images to github actions (#1092)
* Onboarding jenkins prod docker images to github actions
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
---------
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
commit 040cd7e33f8e696ffe7748140c9b0ecc7475d513
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:43:02 2023 -0700
dependabot: bump net.bytebuddy:byte-buddy from 1.14.6 to 1.14.9 (#1081)
Bumps [net.bytebuddy:byte-buddy](https://github.com/raphw/byte-buddy) from 1.14.6 to 1.14.9.
- [Release notes](https://github.com/raphw/byte-buddy/releases)
- [Changelog](https://github.com/raphw/byte-buddy/blob/master/release-notes.md)
- [Commits](https://github.com/raphw/byte-buddy/compare/byte-buddy-1.14.6...byte-buddy-1.14.9)
---
updated-dependencies:
- dependency-name: net.bytebuddy:byte-buddy
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit dd9c1521bc1946027245d65e39a7844cdf04a8b7
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:42:15 2023 -0700
dependabot: bump aws-actions/configure-aws-credentials (#1076)
Bumps [aws-actions/configure-aws-credentials](https://github.com/aws-actions/configure-aws-credentials) from 1.7.0 to 4.0.1.
- [Release notes](https://github.com/aws-actions/configure-aws-credentials/releases)
- [Changelog](https://github.com/aws-actions/configure-aws-credentials/blob/main/CHANGELOG.md)
- [Commits](https://github.com/aws-actions/configure-aws-credentials/compare/v1.7.0...v4.0.1)
---
updated-dependencies:
- dependency-name: aws-actions/configure-aws-credentials
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit d6e3fd7a69b1daea45d7a455335e55b6de118033
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:05:00 2023 -0700
dependabot: bump com.netflix.nebula.ospackage from 11.0.0 to 11.5.0 (#1066)
Bumps com.netflix.nebula.ospackage from 11.0.0 to 11.5.0.
---
updated-dependencies:
- dependency-name: com.netflix.nebula.ospackage
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 57eacf611ce44559e14aa37f2e51dfbb82d53cc2
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:04:19 2023 -0700
dependabot: bump org.apiguardian:apiguardian-api from 1.1.0 to 1.1.2 (#1058)
Bumps [org.apiguardian:apiguardian-api](https://github.com/apiguardian-team/apiguardian) from 1.1.0 to 1.1.2.
- [Release notes](https://github.com/apiguardian-team/apiguardian/releases)
- [Commits](https://github.com/apiguardian-team/apiguardian/compare/r1.1.0...r1.1.2)
---
updated-dependencies:
- dependency-name: org.apiguardian:apiguardian-api
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 6b9faf2b71e5481be366b12bd6f16440c6c8ef89
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:04:01 2023 -0700
dependabot: bump org.junit.platform:junit-platform-launcher (#1056)
Bumps [org.junit.platform:junit-platform-launcher](https://github.com/junit-team/junit5) from 1.9.2 to 1.10.0.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/commits)
---
updated-dependencies:
- dependency-name: org.junit.platform:junit-platform-launcher
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 2a957f2086688b5ee76703406105797d31207cc5
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:03:11 2023 -0700
Bump urllib3 from 1.26.9 to 1.26.17 in /dataGeneration (#1068)
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.9 to 1.26.17.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.9...1.26.17)
---
updated-dependencies:
- dependency-name: urllib3
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit a12e33214f9c138946975801cefa2bd39c7978a9
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 11:29:37 2023 -0700
dependabot: bump org.objenesis:objenesis from 3.0.1 to 3.3 (#1040)
Bumps [org.objenesis:objenesis](https://github.com/easymock/objenesis) from 3.0.1 to 3.3.
- [Release notes](https://github.com/easymock/objenesis/releases)
- [Commits](https://github.com/easymock/objenesis/compare/3.0.1...3.3)
---
updated-dependencies:
- dependency-name: org.objenesis:objenesis
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 5a4ba14a431fbc53f757416542cda25ef2fae58c
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 11:28:46 2023 -0700
dependabot: bump tibdex/github-app-token from 2.0.0 to 2.1.0 (#1065)
Bumps [tibdex/github-app-token](https://github.com/tibdex/github-app-token) from 2.0.0 to 2.1.0.
- [Release notes](https://github.com/tibdex/github-app-token/releases)
- [Commits](https://github.com/tibdex/github-app-token/compare/v2.0.0...v2.1.0)
---
updated-dependencies:
- dependency-name: tibdex/github-app-token
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 713d556d980ccb144eb6ae952cebc7b3963ed28c
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 15:05:44 2023 -0700
dependabot: bump actions/setup-java from 1 to 3 (#1035)
Bumps [actions/setup-java](https://github.com/actions/setup-java) from 1 to 3.
- [Release notes](https://github.com/actions/setup-java/releases)
- [Commits](https://github.com/actions/setup-java/compare/v1...v3)
---
updated-dependencies:
- dependency-name: actions/setup-java
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 574ac521653ede84e7b821bc3c06049f1054a6ad
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 10:53:02 2023 -0700
dependabot: bump tibdex/github-app-token from 1.5.0 to 2.0.0 (#1042)
Bumps [tibdex/github-app-token](https://github.com/tibdex/github-app-token) from 1.5.0 to 2.0.0.
- [Release notes](https://github.com/tibdex/github-app-token/releases)
- [Commits](https://github.com/tibdex/github-app-token/compare/v1.5.0...v2.0.0)
---
updated-dependencies:
- dependency-name: tibdex/github-app-token
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 65e207aef49a6872408ae02e4f49cdd9060c1ef0
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 10:52:40 2023 -0700
dependabot: bump org.apache.commons:commons-pool2 from 2.10.0 to 2.11.1 (#1045)
Bumps org.apache.commons:commons-pool2 from 2.10.0 to 2.11.1.
---
updated-dependencies:
- dependency-name: org.apache.commons:commons-pool2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit a4ff71926af39726d9b4584102706e3ea7f4fa05
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:16:31 2023 -0400
React to Tracer changes in TransportService (#1034)
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 05d0a3b905cae9d25f6d5d91f30f1b842b9a792f
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:14:20 2023 -0400
Ensure integ tests run with security after plugin rename (#1023)
* Ensure integ tests run with security after plugin rename
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Rename to time-series-analytics
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Switch folder back
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Run integTest with -i
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Remove opensearch-anomaly-detection if installed
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update password rules and change expected error msg
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update password generation
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Fix indexOf condition
Signed-off-by: Craig Perkins <cwperx@amazon.com>
---------
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 72210f014ab54bf4a5b567ebe9dabe13b66c6cbb
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:39 2023 -0700
dependabot: bump codecov/codecov-action from 1 to 3 (#1038)
Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 1 to 3.
- [Release notes](https://github.com/codecov/codecov-action/releases)
- [Changelog](https://github.com/codecov/codecov-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/codecov/codecov-action/compare/v1...v3)
---
updated-dependencies:
- dependency-name: codecov/codecov-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit b77c3a7406e94424550ec1f22f084bc20533994f
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:14 2023 -0700
dependabot: bump com.google.guava:guava from 32.0.1-jre to 32.1.2-jre (#1037)
Bumps [com.google.guava:guava](https://github.com/google/guava) from 32.0.1-jre to 32.1.2-jre.
- [Release notes](https://github.com/google/guava/releases)
- [Commits](https://github.com/google/guava/commits)
---
updated-dependencies:
- dependency-name: com.google.guava:guava
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 18defcc16e81abe590e8f109d6df3c4a060f74ce
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:03 2023 -0700
dependabot: bump VachaShah/backport from 1.1.4 to 2.2.0 (#1039)
Bumps [VachaShah/backport](https://github.com/vachashah/backport) from 1.1.4 to 2.2.0.
- [Release notes](https://github.com/vachashah/backport/releases)
- [Changelog](https://github.com/VachaShah/backport/blob/main/CHANGELOG.md)
- [Commits](https://github.com/vachashah/backport/compare/v1.1.4...v2.2.0)
---
updated-dependencies:
- dependency-name: VachaShah/backport
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 726759f104117e1a28648a1524cdface49168b79
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:53 2023 -0700
dependabot: bump actions/checkout from 2 to 4 (#1041)
Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v2...v4)
---
updated-dependencies:
- dependency-name: actions/checkout
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit f6ac01886a662264323d1e11a2199fb190148c80
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:38 2023 -0700
dependabot: bump org.jacoco:org.jacoco.ant from 0.8.5 to 0.8.10 (#1044)
Bumps [org.jacoco:org.jacoco.ant](https://github.com/jacoco/jacoco) from 0.8.5 to 0.8.10.
- [Release notes](https://github.com/jacoco/jacoco/releases)
- [Commits](https://github.com/jacoco/jacoco/compare/v0.8.5...v0.8.10)
---
updated-dependencies:
- dependency-name: org.jacoco:org.jacoco.ant
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit d30bcc394e6f281b6de504f102a0085ae56e78e4
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:22 2023 -0700
dependabot: bump org.junit.jupiter:junit-jupiter-api (#1043)
Bumps [org.junit.jupiter:junit-jupiter-api](https://github.com/junit-team/junit5) from 5.9.2 to 5.10.0.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/compare/r5.9.2...r5.10.0)
---
updated-dependencies:
- dependency-name: org.junit.jupiter:junit-jupiter-api
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 92256db92f9ed78cb1de9925297c9ff5cce6da74
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:04:23 2023 -0400
Add dependabot.yml (#1026)
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 23611f6d8ccdc9a4c41469ec0a4746290f976b4f
Author: Jackie Han <hnyng@amazon.com>
Date: Fri Sep 8 11:19:31 2023 -0700
Add 2.10 release notes (#1031)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit ee1db57058e08c36e4820637973f18016cf45015
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Wed Sep 6 16:55:00 2023 -0700
Updates demo certs for integ tests (#1018)
Signed-off-by: Owais Kazi <owaiskazi19@gmail.com>
commit 338d72eb692c81802a70fe42556cde70c01cad6a
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Sep 6 16:08:01 2023 -0700
refactor job response (#1017)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit db456c2543a6f1ff6b77db10bd19952768d16182
Author: Jackie Han <hnyng@amazon.com>
Date: Tue Sep 5 15:47:50 2023 -0700
upgrading commons-lang3 version to fix conflict issue (#1012)
* force commons-lang3 version to fix conflict issue
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from upstream version properties file
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* upgrading commons-lang3 version to align with core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit db788f4714233121eba4238869b8db89ae0037d4
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Tue Sep 5 13:58:31 2023 -0700
Adds auto release workflow (#1003)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 327c141e9b70465b1760f9ebf8c001a2e439b01f
Author: Jackie Han <hnyng@amazon.com>
Date: Fri Sep 1 13:00:23 2023 -0700
Revert "Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards (#948)" (#999)
This reverts commit bc1649922ef39619424fc16c64af5836e48a4a12.
commit 4a09b741e1c127a92775cb55f4c56aa5c4f3f6a3
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Aug 21 11:21:36 2023 -0700
Update Gradle Wrapper to 8.2.1 for Enhanced JDK20 Compatibility (#985)
- **Reason for Upgrade**: The migration to JDK20 ([reference](https://github.com/opensearch-project/opensearch-build/blob/aa65a8ecd69f77c3d3104043dd1c48dff708bffa/manifests/3.0.0/opensearch-3.0.0.yml#L9)) rendered the current Gradle version (7.6.1) incompatible.
- **Actions Taken**:
- **Gradle Wrapper Update**: Upgraded the Gradle wrapper to version 8.2.1 to maintain compatibility with JDK20. The gradle wrapper files are generated using the `./gradlew wrapper` command.
- Applied `spotless` due to new formatting requirements in Gradle 8.
- Resolved test "jar hell" issues. Gradle 8 introduced internal JARs to the test classpath that conflicted with dependencies from `org.junit.vintage:junit-vintage-engine`. As a remedy, these conflicting JARs have been excluded.
- **Relevant Pull Requests**:
- [Alerting#893](https://github.com/opensearch-project/alerting/pull/893/files)
- [ML-Commons#892](https://github.com/opensearch-project/ml-commons/pull/892)
- [Security PR](https://github.com/opensearch-project/security/pull/2978)
- **Verification**: Successfully verified the changes using `gradle build`.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 5ac6390e7de643d8177f0a5833995032f3a279ad
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Aug 17 11:08:36 2023 -0700
Refactoring task cache manager for forecasting (#982)
* Refactoring Shared Functionality for Broader Task Compatibility
This PR extracts shared components from `ADTaskCacheManager` into `TaskCacheManager` to support the requirements of the forecasting feature.
**Renamings**:
- **Method-level in `ADTaskCacheManager`**:
- `addDeletedDetector` to `addDeletedConfig`
- `addDeletedDetectorTask` to `addDeletedTask`
- `hasDeletedDetectorTask` to `hasDeletedTask`
- `pollDeletedDetector` to `pollDeletedConfig`
- `pollDeletedDetectorTask` to `pollDeletedTask`
- **Variable-level in `AnomalyDetectorSettings`**:
- `CHECKPOINT_MAINTAIN_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_MAINTAIN_QUEUE_MAX_HEAP_PERCENT`
- `CHECKPOINT_READ_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_READ_QUEUE_MAX_HEAP_PERCENT`
- `CHECKPOINT_SAVING_FREQ` to `AD_CHECKPOINT_SAVING_FREQ`
- `CHECKPOINT_TTL` to `AD_CHECKPOINT_TTL`
- `CHECKPOINT_WRITE_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_WRITE_QUEUE_MAX_HEAP_PERCENT`
- `COLD_ENTITY_QUEUE_MAX_HEAP_PERCENT` to `AD_COLD_ENTITY_QUEUE_MAX_HEAP_PERCENT`
- `DEDICATED_CACHE_SIZE` to `AD_DEDICATED_CACHE_SIZE`
- `ENTITY_COLD_START_QUEUE_CONCURRENCY` to `AD_ENTITY_COLD_START_QUEUE_CONCURRENCY`
- `ENTITY_COLD_START_QUEUE_MAX_HEAP_PERCENT` to `AD_ENTITY_COLD_START_QUEUE_MAX_HEAP_PERCENT`
- `EXPECTED_COLD_ENTITY_EXECUTION_TIME_IN_MILLISECS` to `AD_EXPECTED_COLD_ENTITY_EXECUTION_TIME_IN_MILLISECS`
- `FILTER_BY_BACKEND_ROLES` to `AD_FILTER_BY_BACKEND_ROLES`
- `MAX_ENTITIES_PER_QUERY` to `AD_MAX_ENTITIES_PER_QUERY`
- `MAX_MODEL_SIZE_PER_NODE` to `AD_MAX_MODEL_SIZE_PER_NODE`
- `MAX_MULTI_ENTITY_ANOMALY_DETECTORS` to `AD_MAX_HC_ANOMALY_DETECTORS`
- `MAX_RETRY_FOR_END_RUN_EXCEPTION` to `AD_MAX_RETRY_FOR_END_RUN_EXCEPTION`
- `MAX_SINGLE_ENTITY_ANOMALY_DETECTORS` to `AD_MAX_SINGLE_ENTITY_ANOMALY_DETECTORS`
- `MODEL_MAX_SIZE_PERCENTAGE` to `AD_MODEL_MAX_SIZE_PERCENTAGE`
- `PAGE_SIZE` to `AD_PAGE_SIZE`
- `RESULT_WRITE_QUEUE_MAX_HEAP_PERCENT` to `AD_RESULT_WRITE_QUEUE_MAX_HEAP_PERCENT`
- **Class-level**:
- `ADRealtimeTaskCache` renamed to `RealtimeTaskCache`
- **Package-level**:
- Shifted from `org.opensearch.ad.breaker` to `org.opensearch.timeseries.breaker`
**Migrations**:
- Variables transferred from `AnomalyDetectorSettings` to `TimeSeriesSettings`:
- `BATCH_BOUNDING_BOX_CACHE_RATIO`
- `CHECKPOINT_MAINTAIN_REQUEST_SIZE_IN_BYTES`
- `CHECKPOINT_WRITE_QUEUE_SIZE_IN_BYTES`
- `DEFAULT_AD_JOB_LOC_DURATION_SECONDS` (renamed to `DEFAULT_JOB_LOC_DURATION_SECONDS`)
- `ENTITY_REQUEST_SIZE_IN_BYTES`
- `HOURLY_MAINTENANCE`
- `INTERVAL_RATIO_FOR_REQUESTS`
- `LOW_SEGMENT_PRUNE_RATIO`
- `MAINTENANCE_FREQ_CONSTANT`
- `MAX_COLD_START_ROUNDS`
- `MAX_QUEUED_TASKS_RATIO`
- `MAX_TOTAL_RCF_SERIALIZATION_BUFFERS`
- `MAX_CHECKPOINT_BYTES`
- `MEDIUM_SEGMENT_PRUNE_RATIO`
- `NUM_MIN_SAMPLES`
- `NUM_SAMPLES_PER_TREE`
- `NUM_TREES`
- `QUEUE_MAINTENANCE`
- `RESULT_WRITE_QUEUE_SIZE_IN_BYTES`
- `SERIALIZATION_BUFFER_BYTES`
- `THRESHOLD_MIN_PVALUE`
- `TIME_DECAY`
**Deletions**:
- Obsolete settings and methods:
- `DESIRED_MODEL_SIZE_PERCENTAGE` in `AnomalyDetectorSettings`
- `getDesiredModelSize` in `MemoryTracker`
**Modifications**:
- `MemoryTracker` enums renamed for clear differentiation between real-time and historical memory usage, adding `REAL_TIME_FORECASTER` for a harmonized single-stream and HC analysis approach.
**Tests**:
- Changes validated with a successful Gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 0c5b4b94cb5b192160463fa8a5f58eac587fe95d
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Aug 15 13:09:17 2023 -0700
Update RCF to v3.8 and Enable Auto AD with 'Alert Once' Option (#979)
* Update RCF to v3.8 and Enable Auto AD with 'Alert Once' Option
This PR added support for automatic Anomaly Detection (AD) and the 'Alert Once' option introduced in RCF 3.8.
Testing done:
1. Deserialization Test:
* Verified model deserialization from 3.0-rc3.
* Ensured consistent scoring using the rc3 checkpoint and rc3 dependency on identical data.
2. Backward Compatibility Test:
* Executed a mixed cluster with versions 2.10 and 3.0.
* Validated that older detectors still produce results without throwing any exceptions in a blue-green simulation scenario.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* reduce recall since alertOnce reduced recall
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* remove commented out code
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit cadc9bbd949daf4f2669335bfb8629e2137c108d
Author: Joshua Palis <jpalis@amazon.com>
Date: Fri Aug 11 16:02:38 2023 -0700
Fixing imports, adding TermsAggregator BucketCountThresholds for StringTerms, setting AnomalyResult grade to 0 if negative value (#976)
Signed-off-by: Joshua Palis <jpalis@amazon.com>
commit 3985cd2f82f2cfa57604ecf5a512bb042e632cae
Author: Romain Tartière <romain@blogreen.org>
Date: Wed Aug 9 08:59:30 2023 -1000
Fix build with latest OpenSearch (for real this time) (#972)
This is a follow-up to #971, where commit
2839bc2c6f470639b68901086c80cb2152d96558 only fixed _some_ but not _all_
of the build errors (it allowed `./gradlew run` to pass but `./gradlew
build` was failing).
Fix the build errors when we run `./gradlew build`.
Signed-off-by: Romain Tartière <romain@blogreen.org>
commit 2839bc2c6f470639b68901086c80cb2152d96558
Author: Romain Tartière <romain@blogreen.org>
Date: Tue Aug 8 13:15:04 2023 -1000
Fix build with latest OpenSearch (#971)
OpenSearch recently merged some code that cause buid failure for this
module, as spotted in #585.
This change the import to match the new one after
https://github.com/opensearch-project/OpenSearch/pull/9103
Signed-off-by: Romain Tartière <romain@blogreen.org>
commit d4946f04e7ad44f0bc79215962c6678786c592ff
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Aug 7 14:21:56 2023 -0700
Refactor ADTask and Related Components (#969)
* Refactor ADTask and Related Components
This PR includes several key refactoring changes:
- Extracts common code from ADTask into TimeSeriesTask, creating ForecastTask for forecasting-specific logic.
- Consolidates common code from ADTaskType into TaskType and introduces ForecastTaskType for forecasting-related purposes.
- Renames ADTaskState to TaskState for consistent code reuse.
- Renames the method getId in ADTask to getConfigId to differentiate it from other IDs like task id.
Testing done:
1. Added unit tests for the new code to ensure functionality.
2. Executed a successful Gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* add comments and address compiler errors
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Amit's comments and address compiler failure
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 1130a1ba6fc3c08f375dd99f98e93e4ee36331fb
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jul 27 10:39:39 2023 -0700
Refactoring NodeStateManager etc. to support forecasting functionality (#965)
* Refactoring NodeStateManager etc. to support forecasting functionality
This commit extends the codebase to support both Anomaly Detection (AD) and forecasting. It contains a mixture of refactoring, renaming, removal of unused code, and package moving tasks. Here are the details:
Refactoring:
- `NodeStateManager.getAnomalyDetector` is now `getConfig`, with added functionality to fetch a Forecaster. The method comments are updated for clarity.
- Existing methods (`getFeatureSamplesForPeriods`, `getColdStartSamplesForPeriods`, `createPreviewSearchRequest`, `getMinDataTime`) have been added in `SearchFeatureDao` to handle forecasting logic.
- Adjusted `SecurityClientUtil` and `ParseUtils` to handle forecasting logic.
- Cleaned up `NodeState` to differentiate state for AD and forecasting.
Renaming:
- `AnomalyDetectorJob` is renamed to `Job` to facilitate reuse for forecasting.
- `NodeStateManager.getAnomalyDetectorJob` is renamed to `getJob`.
- Certain settings in `AnomalyDetectorSettings` are renamed to reflect they are meant for the AD setting. They have been marked as deprecated and new settings are used in `TimeSeriesSettings` instead.
- `IndexAnomalyDetectorJobActionHandler.getAnomalyDetectorJobForWrite` is renamed to `getJobForWrite`.
- `ADSafeSecurityInjector` is renamed to `TimeSeriesSafeSecurityInjector`.
Removing unused code:
- Synchronous code in `ClientUtil`, `IndexUtils`, and `CheckpointDao` is removed.
- The unused class `Throttler` is deleted.
- Mapping file names are changed, and the code referencing these files is adjusted.
Package moving:
- Several classes (`ClientUtil`, `MultiResponsesDelegateActionListener`, `SafeSecurityInjector`, `SecurityUtil`, `ExceptionUtil`, `SearchFeatureDao`, `CleanState`, `ExpiringState`, `MaintenanceState`, `NodeState`, `SingleStreamModelIdMapper`, `BackPressureRouting`) are moved to the respective `org.opensearch.timeseries` packages.
Miscellaneous:
- Fixed compiler failures caused by changes in https://github.com/opensearch-project/OpenSearch/pull/8730 by replacing `DoubleArrayList` with `java.util.ArrayList`.
- Updates the Backwards Compatibility (bwc) version to align with the core's incremented bwc version as per [OpenSearch PR #8670](https://github.com/opensearch-project/OpenSearch/pull/8670). This change prevents the issue described in [OpenSearch Issue #5076](https://github.com/opensearch-project/OpenSearch/issues/5076).
Testing:
- Executed a `gradle build`.
- Added new tests for `ClientUtil` and `NodeStateManager`.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comment
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* fix compiler error and comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit f0ed43b1aa3c5d80dc6f23a5dd4465bb03ef1739
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jul 17 15:18:03 2023 -0700
Rename AD to time series analytics & Resolve Compiler Errors (#951)
This commit focuses on renaming the AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin as well as addressing compiler errors due to package import changes. The primary transformations are:
* Renamed AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin.
* Updated all references from AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin.
* Amended plugin information in build.gradle and src/main/resources/es-plugin.properties.
* Switched job type in TimeSeriesAnalyticsPlugin from opendistro_anomaly_detector to opensearch_time_series_analytics.
These changes led to the modification of our plugin binary from opensearch-anomaly-detection-3.0.0.0-SNAPSHOT.jar to opensearch-time-series-analytics-3.0.0.0-SNAPSHOT.jar.
Moreover, following changes from OpenSearch Pull Request #8157, compiler errors were encountered, which were resolved by updating the import packages
* org.opensearch.common.io.stream.NamedWriteableRegistry => org.opensearch.core.common.io.stream.NamedWriteableRegistry
* org.opensearch.common.xcontent.XContentParserUtils => * org.opensearch.core.xcontent.XContentParserUtils
* org.opensearch.common.bytes.BytesArray => org.opensearch.core.common.bytes.BytesArray * org.opensearch.common.io.stream.StreamInput => * org.opensearch.core.common.io.stream.StreamInput ** org.opensearch.common.io.stream.StreamOutput => org.opensearch.core.common.io.stream.StreamOutput
* org.opensearch.common.io.stream.Writeable => org.opensearch.core.common.io.stream.Writeable
* org.opensearch.common.io.stream.NotSerializableExceptionWrapper => org.opensearch.core.common.io.stream.NotSerializableExceptionWrapper
* org.opensearch.rest.RestStatus => org.opensearch.core.rest.RestStatus
* org.opensearch.common.ParsingException => org.opensearch.core.common.ParsingException
* org.opensearch.common.bytes.BytesReference => org.opensearch.core.common.bytes.BytesReference
* org.opensearch.common.io.stream.InputStreamStreamInput => org.opensearch.core.common.io.stream.InputStreamStreamInput
* org.opensearch.common.io.stream.OutputStreamStreamOutput => org.opensearch.core.common.io.stream.OutputStreamStreamOutput
* org.opensearch.index.shard.ShardId => org.opensearch.core.index.shard.ShardId* org.opensearch.index.Index => org.opensearch.core.index.Index
* org.opensearch.core.index.IndexNotFoundException => org.opensearch.index.IndexNotFoundException
Validation steps were executed to ensure these changes did not break functionality:
* gradle build was successful. A local build was required due to outdated OpenSearch and job scheduler nightly builds.
* Backward compatibility tests were performed on a two-node 2.9 cluster running some detectors. These detectors continued to produce results on a 3.0 cluster with these updates.
* I can start new detectors on the 3.0 node.
* After shutting down a 2.9 node, the job transfer to the 3.0 node was successful and the job continued to perform as expected.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit c7c6a46e88e15f615fc9dae0499cf0d674662057
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Thu Jul 13 15:42:46 2023 -0700
Add 2.9 release notes (#952)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit bc1649922ef39619424fc16c64af5836e48a4a12
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Jul 11 13:34:09 2023 -0700
Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards (#948)
* Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards
In this PR, we temporarily enforce DOCUMENT replication for AD indices. This change is necessary due to the current limitation of SegRep, which doesn't support Get/MultiGet by ID. This measure will be in place until SegRep adds support for these operations.
This adjustment aligns with the modification made in the referenced PR: job-scheduler PR #417
Additionally, this PR increases the number of primary shards for forecasting indices from 10 to 20, recognizing the higher write intensity of these indices. For instance, when the horizon is 24, we are expected to save 25 documents: 24 for each forecast and 1 for the actual value. In contrast, for AD, we save one document per actual value.
Testing done:
1. gradle build passed
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Fix comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit a1203827617ee42b35d41cb8b010719f334f73b7
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jul 10 10:53:17 2023 -0700
Add ForecastResult and Refactor Shared Code (#941)
This commit adds the functionality of ForecastResult, while also performing several necessary refactorings.
Firstly, we introduce ForecastResult, which closely mirrors the functionality of AnomalyResult. Any shared code between these two classes has been abstracted out into a new parent class, IndexableResult. This refactoring was undertaken to facilitate code reuse and improve maintainability, as both classes deal with storing fields that need to be saved in result indices.
Secondly, we've also extracted common code from ThresholdingResult into another new class, IntermediateResult. This work is in preparation for a forthcoming PR which will introduce RCFCasterResult. In this change, we moved the 'toAnomalyResult' method to IndexableResult, and renamed it to 'toIndexableResults'. This renaming allows for reuse in the upcoming RCFCasterResult. The updated method now returns a list of results instead of a single result. The shift caters for the RCFCasterResult use case where one RCFCasterResult is stored across multiple ForecastResult documents.
Furthermore, this commit modifies the 'entity' field in several methods to be of the Optional type, indicating that it can be empty. This change provides a clear signal to other developers about the optional nature of these fields.
In addition, this commit updates the mapping for the forecast result index. The prior mapping was a placeholder and this change brings it up to date.
We've also moved to using httpcore5 and httpclient5 versions from OpenSearch core, as necessitated by recent changes in [OpenSearch PR #8434](https://github.com/opensearch-project/OpenSearch/pull/8434/files). This shift resolves potential jar hell issues with httpcore5 and httpclient5.
Lastly, we've made name and package changes:
1. Renamed 'initDetectionStateIndex' in ADIndexManagement to 'initStateIndex' to align with ForecastIndexManagement naming.
2. Moved the 'DataByFeatureId' class to the 'timeseries' package for better organization.
This commit also completes the 'createDummyIndexRequest' method in ForecastIndexManagement by invoking 'ForecastResult.getDummyResult()', which is now possible due to the introduction of the ForecastResult implementation.
Testing done:
1. added tests for new code
2. gralde build passes
3. e2e tests
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit f24d9e32ff739abf29cac3da15fd00f74219e213
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Thu Jul 6 17:28:09 2023 -0700
Bump scipy from 1.8.0 to 1.10.0 in /dataGeneration (#943)
Bumps [scipy](https://github.com/scipy/scipy) from 1.8.0 to 1.10.0.
- [Release notes](https://github.com/scipy/scipy/releases)
- [Commits](https://github.com/scipy/scipy/compare/v1.8.0...v1.10.0)
---
updated-dependencies:
- dependency-name: scipy
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 9b9fd2ba3f3e678d717c0a45af8069bb67828808
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Jun 27 16:08:55 2023 -0700
bump guava version to 32.0.1 (#933)
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit 99749dfa6bfc8a2f2c4660ca01d75d1ad57124a5
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jun 26 16:46:24 2023 -0700
Refactoring Index Creation for Improved Code Reuse and Consistency (#932)
This Pull Request significantly refactors the index creation module to promote greater code reusability and consistency. The primary changes are outlined as follows:
1. Code Migration: Common code segments have been moved from AnomalyDetectionIndices to IndexManagement. In addition, component-specific code has been established in ADIndexManagement and ForecastIndexManagement. The bulk of changes are concentrated in these three classes, with the remainder of the modifications relating to reference/test changes.
2. Function Renaming: Several functions have been renamed for broader applicability and consistency:
* AnomalyDetectorFunction has been renamed to ExecutorFunction for potential use in Forecasting.
* AnomalyDetectorSettings.MAX_PRIMARY_SHARDS has been renamed to AnomalyDetectorSettings.AD_MAX_PRIMARY_SHARDS in light of the new ForecastSettings.FORECAST_MAX_PRIMARY_SHARDS.
* doesAnomalyDetectorJobIndexExist() has been renamed to doesJobIndexExist() to allow for job index reusability across Anomaly Detection (AD) and forecasting. Analogous changes have been made to other job index-related functions.
* doesAnomalyDetectorIndexExist() has been renamed to doesConfigIndexExist() to allow for config index reusability across AD and forecasting. Analogous changes have been made to other config index-related functions.
* detectionIndices.doesDetectorStateIndexExist() has been renamed to detectionIndices.doesStateIndexExist(), as the former name was unnecessarily redundant. Similar modifications have been made to the result and checkpoint index.
3. Class Migration: The classes ThrowingSupplierWrapper, ThrowingConsumer, and ThrowingSupplier have been moved from org.opensearch.ad.util to org.opensearch.timeseries.function to promote code reuse.
4. Initial Forecast Indices' Mapping: An initial version of forecast indices' mapping has been added, which can be adjusted as required in the future.
5. In terms of version updates, 2.x has been bumped to 2.9, prompting an increment of the Backward Compatibility (BWC) test version to 2.9.
6. Update dependency com.google.guava:guava to v32 for cve fix.
Testing done:
Testing has been performed with new tests added for forecast index creation, and the grade build passes successfully.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit aedb781a6b1df984636d72d50b65d41138539918
Author: Craig Perkins <craig5008@gmail.com>
Date: Tue Jun 20 16:55:19 2023 -0400
Fix main build - update import of Releasable and remove reference to BaseExceptionsHelper (#930)
* Fix main build - update import of Releasable and remove reference to BaseExceptionsHelper
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update imports in test classes
Signed-off-by: Craig Perkins <cwperx@amazon.com>
---------
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit fce78c29c0375ae06f56e16c85fb98933401e28f
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Jun 14 10:36:40 2023 -0700
Refactor: Reorganize code for Forecasting and AnomalyDetector packages (#925)
* Refactor: Reorganize code for Forecasting and AnomalyDetector packages
This PR includes several refactorings to increase code reuse and improve readability:
1. Entity, FeatureData, and RestHandlerUtils have been moved from the 'ad' package to the 'timeseries' package, enabling their use within the Forecasting code.
2. A new class, DataByFeatureId, has been created to hold shared code previously located in FeatureData. FeatureData now inherits from DataByFeatureId. The standalone usage of DataByFeatureId will be detailed in subsequent PRs.
3. Renamed checkAnomalyDetectorFeaturesSyntax to checkFeaturesSyntax in RestHandlerUtils to make it more generic and usable for Forecasting.
4. Constants AGG_NAME_MAX_TIME, AGG_NAME_MIN_TIME, DATE_HISTOGRAM, and FEATURE_AGGS have been moved from ADCommonName to CommonName to make them accessible for Forecasting.
5. A new method, parseConfig, has been added to the Config class. This method can parse configuration for either AnomalyDetector or Forecaster based on input.
Testing:
The changes have been validated with a successful gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Amit and Owais's comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 02c120f025f73f3d45a8477c7ef8b4873befebfa
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jun 12 11:54:39 2023 -0700
Updated Maintainers and CODE_OWNERS list (#926)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 2ea4dcf430b40a710a0babb04881eeff9fb2d689
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jun 8 15:11:44 2023 -0700
Add Forecaster class (#920)
* Add Forecaster class
This PR adds class Forecaster that serves as the configuration POJO for forecasting. Shared code between AnomalyDetector and Forecaster is extracted and moved to the Config class to reduce duplication and promote reusability. References to the common code in related classes have also been adjusted.
Testing done:
1. gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* fix compiler error due to a recent core change
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Sudipto and Amit's comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit ee04225349a5f0f003d56e77a3243386f4a9673d
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri Jun 2 15:42:19 2023 -0700
Refactor: Migrate files from 'ad' to 'timeseries' package (#918)
* Refactor: Migrate files from 'ad' to 'timeseries' package
This commit involves moving various files from the 'ad' package to the 'timeseries' package. All changes to dependent imports were handled automatically through the IDE, and no changes to file contents were made in the process.
Testing done:
- gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* move ParseUtils to util package
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 472868d165c2234eece8827584f64086aaf7ae92
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jun 1 11:17:16 2023 -0700
Refactor Shared Settings, Introduce Dynamic Forecast Settings, Rename (#912)
* Refactor Shared Settings, Introduce Dynamic Forecast Settings, and Rename Checkpoint mapping File
This commit has undertaken three changes:
* Refactoring of Shared Settings: I've performed a refactoring to unify the settings that are shared between the AD and forecasting modules.
* Introduction of Dynamic Forecast Settings: To increase the adaptability of our system, I've implemented dynamic forecast settings. These settings mirror the existing structure of the AD dynamic settings and will enable us to adjust forecast settings on-the-fly.
* Renaming of Checkpoint File: To enhance the consistency across our AD mapping files, I've renamed checkpoint.json to anomaly-checkpoint.java.
Testing done:
1. added tests for new settings.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* name change and delete files
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 04ab91e60e9d71765a7b9df10b86e0e53ba4d715
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 31 12:18:54 2023 -0700
add 2.8 release notes (#915)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 98da8dffe8d336793ae35658015650b0f83aeef1
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 24 14:37:38 2023 -0700
Implementing Multiple Imputation Methods for Missing Values (#907)
* Implementing Multiple Imputation Methods for Missing Values
This Pull Request introduces multiple imputation methods to handle missing data in Anomaly Detection (AD) and forecasting. The ability to handle missing data is crucial to improve the robustness and accuracy of our models.
The following imputation methods have been implemented:
* Zero Imputation (ZERO): This method replaces all missing values with 0's. It's a simple approach, but it may introduce bias if the data is not centered around zero.
* Fixed Values Imputation (FIXED_VALUES): This method replaces missing values with a predefined set of values. The values are the same for each input dimension, and they need to be specified by the user.
* Previous Value Imputation (PREVIOUS): This method replaces missing values with the last known value in the respective input dimension. It's a commonly used method for time series data, where temporal continuity is expected.
* Linear Interpolation (LINEAR): This method estimates missing values by interpolating linearly between known values in the respective input dimension. This method assumes that the data follows a linear trend.
These methods are designed to provide a set of options for users to handle missing data based on their specific needs and the nature of their data.
Testing Done:
The code changes in this pull request have been validated through a gradle build to ensure that all new and existing tests pass successfully.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Various changes
The commit makes all new files use the shortened header text and addresses compiler/test issues due to core refactoring
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit da608aaa3d3f955efe32b0cb33b3c8cfdd7a7718
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue May 16 11:37:34 2023 -0700
Code Refactoring for CommonMessages (#902)
* Code Refactoring for CommonMessages
In this pull request, I have refactored the code related to shared log or error messages in both AD and forecasting modules to CommonMessages. Additionally, the previously used CommonErrorMessages has been renamed to ADCommonMessages. For the Forecasting module, I have introduced new names in ForecastCommonMessages.
Testing done:
* gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Update string constants wording
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve wording and remove redundant variables
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 041d6ce73d37f1697013b2d2f0683fbfe012247c
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri May 12 13:05:56 2023 -0700
Code Refactoring for CommonName (#901)
In this pull request, I have refactored the code related to shared names in both AD and forecasting modules to CommonNames. Additionally, the previously used CommonName has been renamed to ADCommonName. For the Forecasting module, I have introduced new names in ForecastCommonNames.
Testing done:
* gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit e2fee9d6ba59cc2a23eadbb50a80414fcc7dbf8f
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 10 17:26:31 2023 -0700
Update outdated MAINTAINERS and OWNERS list (#898)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 98b566d1ec57ffd8970b5180c54b493deb1a24ac
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Wed May 10 18:03:04 2023 -0400
Sync up CODEOWNERS with MAINTAINERS.md. (#897)
Signed-off-by: dblock <dblock@amazon.com>
commit 1f8415aa39fa4ec3ba016214255aa0e79b7c7d63
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue May 9 12:55:35 2023 -0700
Various fixes (#886)
* Various fixes
This pull request addresses several issues related to the compiler and tests in the current main branch.
The first major change involves replacing ImmutableOpenMap with java.util.Map in the core. This modification is implemented in the following pull requests:
https://github.com/opensearch-project/OpenSearch/pull/7165
https://github.com/opensearch-project/OpenSearch/pull/7301
To accommodate this change, the codebase of the AD (Anomaly Detection) module has been refactored to utilize JDK maps. As a consequence of this change, passing null to the custom parameters of ClusterState is no longer permissible, as it leads to a NullPointerException. The error stack trace is as follows:
java.lang.NullPointerException: Cannot invoke "Object.getClass()" because "m" is null
at __randomizedtesting.SeedInfo.seed([60CDDB34427ACD0C:6E72DB4ED18E018D]:0)
at java.base/java.util.Collections.unmodifiableMap(Collections.java:1476)
at org.opensearch.cluster.ClusterState.<init>(ClusterState.java:219)
at org.opensearch.ad.transport.DeleteAnomalyDetectorTests.createClusterState(DeleteAnomalyDetectorTests.java:216)
at org.opensearch.ad.transport.DeleteAnomalyDetectorTests.testDeleteADTransportAction_LatestDetectorLevelTask(DeleteAnomalyDetectorTests.java:160)
To address this issue, we have replaced the usage of null with new HashMap<>().
The second change in this pull request aligns with the modifications introduced in PR https://github.com/opensearch-project/anomaly-detection/pull/878.
The third issue is related to the incompatibility between tests that utilize the @Parameters annotation and those that do not, as explained in https://tinyurl.com/2y265s2w. Specifically, the SearchFeatureDaoTests class runes tests with the @Parameters annotation, whereas SearchFeatureDao tests do not.
Testing done:
1. gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 0a48da9e1a0cd70c64cc2da228674baaf377c89e
Author: Jackie Han <hnyng@amazon.com>
Date: Mon Apr 17 12:44:06 2023 -0700
Add 2.7 release notes (#871)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 1edc2ef1ccfe20938711984744b20d1f2ec96a3c
Author: Jackie Han <hnyng@amazon.com>
Date: Tue Apr 11 17:53:57 2023 -0700
Update OpenSearchRejectedExecutionException import (#861)
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update NodeInfo constructor and javadoc for isAdmin method
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit b8df172c2364997c446096e960068d6fc5d2e6f6
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Apr 11 10:55:28 2023 -0700
Giving admin priority over backendrole filtering (#850)
* giving admin priority over backend role filtering
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
* fix security tests
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
* remove redundent line in test case
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
---------
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit fd2fd5d5f63c9004b9f265e3c1e4475282447da8
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Thu Mar 16 14:30:32 2023 -0400
Created untriaged issue workflow. (#809)
Signed-off-by: dblock <dblock@amazon.com>
commit fd547014fdde5114bbc9c8e49fe7aaa37eb6e793
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Mar 1 16:41:05 2023 -0800
Publish snapshots to maven via GHA, fix spotless errors, and bump bwc version (#827)
We are de-coupling the task of publishing the maven snapshots from centralized build workflow to individual repositories. This PR publishes maven snapshots using GitHub Actions.
Testing done:
1. ran ./gradlew publishPluginZipPublicationToSnapshotsRepository according to https://github.com/opensearch-project/anomaly-detection/issues/813
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit b6be5960fb8cff41f0e9d13d5f5a971c289b80ed
Author: Jackie Han <hnyng@amazon.com>
Date: Thu Feb 23 12:23:01 2023 -0800
Update xcontent imports (#822)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 1dcb78a6c4d1331133aefe5af7adf137daa8846f
Author: Jackie Han <hnyng@amazon.com>
Date: Wed Feb 22 11:17:21 2023 -0800
Add 2.6 release note (#818)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 553688aae45590c37cc4d86102642d0b3a6ebb33
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Feb 9 13:38:14 2023 -0800
Revert changes to exception message (#803)
* Revert changes to exception message
We used to log "No RCF models are available either because RCF models are not ready..." and now we log "resource_not_found_exception: No checkpoints found for model id...". This change caused an integration test failure. This PR reverts it back.
Testing done:
1. verified that the original log is back.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* check NO_MODEL_ERR_MSG instead of NO_CHECKPOINT_ERR_MSG
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit c9bdc628a03c4ced3cd1ebeec44ebff792d7ff98
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri Feb 3 11:15:37 2023 -0800
fixing dls/fls logic around numeric aggregations (#801)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 9cebc5bc97a84dd78ac8892863ff7d674428bced
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Jan 10 02:17:04 2023 +0000
adding 2.5 release notes
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit 2ace84643fd199a5e5179e6d21ab76ae212cb7d8
Author: Ryan Bogan <10944539+ryanbogan@users.noreply.github.com>
Date: Tue Jan 10 13:31:49 2023 -0800
Add jackson back to build.gradle (#780)
Signed-off-by: Ryan Bogan <rbogan@amazon.com>
commit a5d60eefab5ac30ef5243da8e7a88b7a2189cd5c
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jan 9 15:49:35 2023 -0800
bump bwc to 2.6.0 (#775)
We need to bump the version because only the latest 2.x will be upgradable to 3.0 when that ship. Since OpenSearch core bumped to 2.6, we need to do that as well. Note after bumping version, bwc still fails to find 2.6.0 core zip.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 27ed49863bfbef90551cdfacc6b51703bf622e25
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jan 9 12:17:57 2023 -0800
Fix the discrepancy between Profile API and real time tasks API (#770)
* Fix the discrepancy between Profile API and real time tasks API
This PR fixes the discrepancy by querying the result index when the total updates is less than 32. We have done similar things in profile API so I refactored reusable code to ProfileUtil. We also cached whether we have queried the result index and won't repeatedly issue the extra query.
Testing done:
1. repeated repro steps in https://github.com/opensearch-project/anomaly-detection/issues/502 and verified the issue has been resolved.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit b49a36b3e7962a205695d451e0497ee4f57fb2cb
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Thu Jan 5 10:19:51 2023 -0800
Updated MAIN…
kaituo
added a commit
to kaituo/anomaly-detection-1
that referenced
this pull request
Mar 27, 2024
commit 30347847cb4ec87f7318587d97054d91c341a312
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Mar 26 13:40:53 2024 -0700
Upgrade rcf to 4.0 (#1173)
This PR upgrades rcf to 4.0 as it has bug fixes and support for streaming imputation mode.
Testing done:
1. gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 8ca1d0d837dd28b6e0820756136eafb8c3ce03ad
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Mar 25 13:44:45 2024 -0700
dependabot: bump actions/checkout from 3 to 4 (#1098)
Bumps [actions/checkout](https://github.com/actions/checkout) from 3 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v3...v4)
---
updated-dependencies:
- dependency-name: actions/checkout
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit d0a2a8ff9fd9640000763c433e05577eea292c48
Author: Darshit Chanpura <35282393+DarshitChanpura@users.noreply.github.com>
Date: Mon Mar 25 16:44:36 2024 -0400
Updates sample cert and admin keystore (#1163)
Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
commit 1921e12b30ac442cd731a5d7a3bdfd3bc31be82b
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Mar 25 13:14:52 2024 -0700
Bump urllib3 from 1.26.17 to 1.26.18 in /dataGeneration (#1090)
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.17 to 1.26.18.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.17...1.26.18)
---
updated-dependencies:
- dependency-name: urllib3
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 8521a76533b533d6887321505c7b5e3d473b02ae
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Mar 25 13:14:18 2024 -0700
dependabot: bump org.apache.commons:commons-pool2 from 2.11.1 to 2.12.0 (#1088)
Bumps org.apache.commons:commons-pool2 from 2.11.1 to 2.12.0.
---
updated-dependencies:
- dependency-name: org.apache.commons:commons-pool2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 303ceb5b320f148dcd015ab6a11f870ae3e23125
Author: Joshua Palis <jpalis@amazon.com>
Date: Mon Mar 18 16:49:59 2024 -0700
Adding 2.13 release notes (#1170)
Signed-off-by: Joshua Palis <jpalis@amazon.com>
commit 1507dd4b4045bd8e8cdf505d07041ce304788ca0
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Feb 21 15:59:34 2024 -0800
Inject NamedWriteableRegistry in AD node client (#1164)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 5b85720d442d1b43001dde0c20248fd4a20a64b0
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Tue Feb 13 10:20:20 2024 -0800
Fixed lucene url (#1158)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 290bdcd832a0cae6d039787d9f0af73ea6be2ec2
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Feb 6 16:14:49 2024 -0800
add 2.12 release notes (#1152)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 6a6eec347379c997f0f7acc88b027bc1ffdd8f54
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Tue Jan 30 18:20:36 2024 -0800
Add ser/deser to get AD transport action request (#1150)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 475f0c36e5b6267aaeb101627b9c3ae1fcca3a88
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Thu Jan 25 14:37:12 2024 -0800
Updated lucene snapshot url (#1146)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 7192d848d2923566a409901909f342a63695e1c2
Author: Jackie Han <hnyng@amazon.com>
Date: Thu Jan 25 09:48:37 2024 -0800
Remove default admin credentials (#1134)
* Remove default admin credentials
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Replace default password with a placeholder in README files
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 97482c19b0eded34a7f435e589303a834c258aa3
Author: Jackie Han <hnyng@amazon.com>
Date: Wed Jan 24 09:39:55 2024 -0800
Require JDK version for java spotless check (#1129)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 708e0462189677a217b35905c2feba5486c77cdc
Author: Andriy Redko <andriy.redko@aiven.io>
Date: Tue Jan 23 15:11:39 2024 -0500
Update to Jackson 2.16.1 (#1135)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
commit 7c0ce4cb554a05230ecf5365b903219f357997bf
Author: Andriy Redko <drreta@gmail.com>
Date: Tue Jan 16 17:51:37 2024 -0500
Update to Gradle 8.5 (#1131)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
commit e5cbe93c0e9cadebe2a30cba83f99ae8a3f8fe57
Author: zane-neo <zaniu@amazon.com>
Date: Thu Jan 4 16:50:47 2024 +0800
add publishToMavenLocal task to fix zip plugin not pulished to maven local issue when running this script (#1121)
Signed-off-by: zane-neo <zaniu@amazon.com>
commit 106dc25b3ef36beae329dc7882bcdf9c23347fb5
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Dec 27 16:33:25 2023 -0800
Refactor client's getDetectorProfile to use GetAnomalyDetectorTransportAction (#1124)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 59b4ebecfa11cac977f49c999ce85637fb6fac58
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Dec 27 11:56:00 2023 -0800
Add profile transport action to AD client (#1119)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 29711f96dbb2c9abc1181b933a8b334eed63ca66
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Tue Dec 12 08:32:53 2023 -0800
Add an AD transport client (#1110)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 353dcaeb05f8b75fa74d92e2ae8415ab018bc68e
Author: Daniel Widdis <widdis@gmail.com>
Date: Wed Nov 22 13:59:53 2023 -0800
Fix build, update CVE-affected versions (#1102)
* Fix build, update CVE-affected versions
Signed-off-by: Daniel Widdis <widdis@gmail.com>
* Spotless depends on CVE-impacted eclipse dependency, now needs JDK17+
Signed-off-by: Daniel Widdis <widdis@gmail.com>
---------
Signed-off-by: Daniel Widdis <widdis@gmail.com>
commit 4c6ba48bf9fb9234ad8bc0b9193f3c68409acfb9
Author: Peter Zhu <zhujiaxi@amazon.com>
Date: Mon Oct 30 19:35:01 2023 -0400
Fix the bwc test version retrieval (#1093)
* Onboarding jenkins prod docker images to github actions
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
---------
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
commit a1da3aa0eefc6671446d2eb3bc670bad6449d2f0
Author: Peter Zhu <zhujiaxi@amazon.com>
Date: Mon Oct 30 19:14:31 2023 -0400
Onboarding jenkins prod docker images to github actions (#1092)
* Onboarding jenkins prod docker images to github actions
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
---------
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
commit 040cd7e33f8e696ffe7748140c9b0ecc7475d513
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:43:02 2023 -0700
dependabot: bump net.bytebuddy:byte-buddy from 1.14.6 to 1.14.9 (#1081)
Bumps [net.bytebuddy:byte-buddy](https://github.com/raphw/byte-buddy) from 1.14.6 to 1.14.9.
- [Release notes](https://github.com/raphw/byte-buddy/releases)
- [Changelog](https://github.com/raphw/byte-buddy/blob/master/release-notes.md)
- [Commits](https://github.com/raphw/byte-buddy/compare/byte-buddy-1.14.6...byte-buddy-1.14.9)
---
updated-dependencies:
- dependency-name: net.bytebuddy:byte-buddy
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit dd9c1521bc1946027245d65e39a7844cdf04a8b7
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:42:15 2023 -0700
dependabot: bump aws-actions/configure-aws-credentials (#1076)
Bumps [aws-actions/configure-aws-credentials](https://github.com/aws-actions/configure-aws-credentials) from 1.7.0 to 4.0.1.
- [Release notes](https://github.com/aws-actions/configure-aws-credentials/releases)
- [Changelog](https://github.com/aws-actions/configure-aws-credentials/blob/main/CHANGELOG.md)
- [Commits](https://github.com/aws-actions/configure-aws-credentials/compare/v1.7.0...v4.0.1)
---
updated-dependencies:
- dependency-name: aws-actions/configure-aws-credentials
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit d6e3fd7a69b1daea45d7a455335e55b6de118033
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:05:00 2023 -0700
dependabot: bump com.netflix.nebula.ospackage from 11.0.0 to 11.5.0 (#1066)
Bumps com.netflix.nebula.ospackage from 11.0.0 to 11.5.0.
---
updated-dependencies:
- dependency-name: com.netflix.nebula.ospackage
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 57eacf611ce44559e14aa37f2e51dfbb82d53cc2
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:04:19 2023 -0700
dependabot: bump org.apiguardian:apiguardian-api from 1.1.0 to 1.1.2 (#1058)
Bumps [org.apiguardian:apiguardian-api](https://github.com/apiguardian-team/apiguardian) from 1.1.0 to 1.1.2.
- [Release notes](https://github.com/apiguardian-team/apiguardian/releases)
- [Commits](https://github.com/apiguardian-team/apiguardian/compare/r1.1.0...r1.1.2)
---
updated-dependencies:
- dependency-name: org.apiguardian:apiguardian-api
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 6b9faf2b71e5481be366b12bd6f16440c6c8ef89
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:04:01 2023 -0700
dependabot: bump org.junit.platform:junit-platform-launcher (#1056)
Bumps [org.junit.platform:junit-platform-launcher](https://github.com/junit-team/junit5) from 1.9.2 to 1.10.0.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/commits)
---
updated-dependencies:
- dependency-name: org.junit.platform:junit-platform-launcher
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 2a957f2086688b5ee76703406105797d31207cc5
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:03:11 2023 -0700
Bump urllib3 from 1.26.9 to 1.26.17 in /dataGeneration (#1068)
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.9 to 1.26.17.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.9...1.26.17)
---
updated-dependencies:
- dependency-name: urllib3
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit a12e33214f9c138946975801cefa2bd39c7978a9
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 11:29:37 2023 -0700
dependabot: bump org.objenesis:objenesis from 3.0.1 to 3.3 (#1040)
Bumps [org.objenesis:objenesis](https://github.com/easymock/objenesis) from 3.0.1 to 3.3.
- [Release notes](https://github.com/easymock/objenesis/releases)
- [Commits](https://github.com/easymock/objenesis/compare/3.0.1...3.3)
---
updated-dependencies:
- dependency-name: org.objenesis:objenesis
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 5a4ba14a431fbc53f757416542cda25ef2fae58c
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 11:28:46 2023 -0700
dependabot: bump tibdex/github-app-token from 2.0.0 to 2.1.0 (#1065)
Bumps [tibdex/github-app-token](https://github.com/tibdex/github-app-token) from 2.0.0 to 2.1.0.
- [Release notes](https://github.com/tibdex/github-app-token/releases)
- [Commits](https://github.com/tibdex/github-app-token/compare/v2.0.0...v2.1.0)
---
updated-dependencies:
- dependency-name: tibdex/github-app-token
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 713d556d980ccb144eb6ae952cebc7b3963ed28c
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 15:05:44 2023 -0700
dependabot: bump actions/setup-java from 1 to 3 (#1035)
Bumps [actions/setup-java](https://github.com/actions/setup-java) from 1 to 3.
- [Release notes](https://github.com/actions/setup-java/releases)
- [Commits](https://github.com/actions/setup-java/compare/v1...v3)
---
updated-dependencies:
- dependency-name: actions/setup-java
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 574ac521653ede84e7b821bc3c06049f1054a6ad
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 10:53:02 2023 -0700
dependabot: bump tibdex/github-app-token from 1.5.0 to 2.0.0 (#1042)
Bumps [tibdex/github-app-token](https://github.com/tibdex/github-app-token) from 1.5.0 to 2.0.0.
- [Release notes](https://github.com/tibdex/github-app-token/releases)
- [Commits](https://github.com/tibdex/github-app-token/compare/v1.5.0...v2.0.0)
---
updated-dependencies:
- dependency-name: tibdex/github-app-token
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 65e207aef49a6872408ae02e4f49cdd9060c1ef0
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 10:52:40 2023 -0700
dependabot: bump org.apache.commons:commons-pool2 from 2.10.0 to 2.11.1 (#1045)
Bumps org.apache.commons:commons-pool2 from 2.10.0 to 2.11.1.
---
updated-dependencies:
- dependency-name: org.apache.commons:commons-pool2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit a4ff71926af39726d9b4584102706e3ea7f4fa05
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:16:31 2023 -0400
React to Tracer changes in TransportService (#1034)
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 05d0a3b905cae9d25f6d5d91f30f1b842b9a792f
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:14:20 2023 -0400
Ensure integ tests run with security after plugin rename (#1023)
* Ensure integ tests run with security after plugin rename
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Rename to time-series-analytics
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Switch folder back
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Run integTest with -i
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Remove opensearch-anomaly-detection if installed
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update password rules and change expected error msg
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update password generation
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Fix indexOf condition
Signed-off-by: Craig Perkins <cwperx@amazon.com>
---------
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 72210f014ab54bf4a5b567ebe9dabe13b66c6cbb
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:39 2023 -0700
dependabot: bump codecov/codecov-action from 1 to 3 (#1038)
Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 1 to 3.
- [Release notes](https://github.com/codecov/codecov-action/releases)
- [Changelog](https://github.com/codecov/codecov-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/codecov/codecov-action/compare/v1...v3)
---
updated-dependencies:
- dependency-name: codecov/codecov-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit b77c3a7406e94424550ec1f22f084bc20533994f
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:14 2023 -0700
dependabot: bump com.google.guava:guava from 32.0.1-jre to 32.1.2-jre (#1037)
Bumps [com.google.guava:guava](https://github.com/google/guava) from 32.0.1-jre to 32.1.2-jre.
- [Release notes](https://github.com/google/guava/releases)
- [Commits](https://github.com/google/guava/commits)
---
updated-dependencies:
- dependency-name: com.google.guava:guava
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 18defcc16e81abe590e8f109d6df3c4a060f74ce
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:03 2023 -0700
dependabot: bump VachaShah/backport from 1.1.4 to 2.2.0 (#1039)
Bumps [VachaShah/backport](https://github.com/vachashah/backport) from 1.1.4 to 2.2.0.
- [Release notes](https://github.com/vachashah/backport/releases)
- [Changelog](https://github.com/VachaShah/backport/blob/main/CHANGELOG.md)
- [Commits](https://github.com/vachashah/backport/compare/v1.1.4...v2.2.0)
---
updated-dependencies:
- dependency-name: VachaShah/backport
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 726759f104117e1a28648a1524cdface49168b79
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:53 2023 -0700
dependabot: bump actions/checkout from 2 to 4 (#1041)
Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v2...v4)
---
updated-dependencies:
- dependency-name: actions/checkout
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit f6ac01886a662264323d1e11a2199fb190148c80
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:38 2023 -0700
dependabot: bump org.jacoco:org.jacoco.ant from 0.8.5 to 0.8.10 (#1044)
Bumps [org.jacoco:org.jacoco.ant](https://github.com/jacoco/jacoco) from 0.8.5 to 0.8.10.
- [Release notes](https://github.com/jacoco/jacoco/releases)
- [Commits](https://github.com/jacoco/jacoco/compare/v0.8.5...v0.8.10)
---
updated-dependencies:
- dependency-name: org.jacoco:org.jacoco.ant
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit d30bcc394e6f281b6de504f102a0085ae56e78e4
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:22 2023 -0700
dependabot: bump org.junit.jupiter:junit-jupiter-api (#1043)
Bumps [org.junit.jupiter:junit-jupiter-api](https://github.com/junit-team/junit5) from 5.9.2 to 5.10.0.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/compare/r5.9.2...r5.10.0)
---
updated-dependencies:
- dependency-name: org.junit.jupiter:junit-jupiter-api
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 92256db92f9ed78cb1de9925297c9ff5cce6da74
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:04:23 2023 -0400
Add dependabot.yml (#1026)
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 23611f6d8ccdc9a4c41469ec0a4746290f976b4f
Author: Jackie Han <hnyng@amazon.com>
Date: Fri Sep 8 11:19:31 2023 -0700
Add 2.10 release notes (#1031)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit ee1db57058e08c36e4820637973f18016cf45015
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Wed Sep 6 16:55:00 2023 -0700
Updates demo certs for integ tests (#1018)
Signed-off-by: Owais Kazi <owaiskazi19@gmail.com>
commit 338d72eb692c81802a70fe42556cde70c01cad6a
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Sep 6 16:08:01 2023 -0700
refactor job response (#1017)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit db456c2543a6f1ff6b77db10bd19952768d16182
Author: Jackie Han <hnyng@amazon.com>
Date: Tue Sep 5 15:47:50 2023 -0700
upgrading commons-lang3 version to fix conflict issue (#1012)
* force commons-lang3 version to fix conflict issue
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from upstream version properties file
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* upgrading commons-lang3 version to align with core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit db788f4714233121eba4238869b8db89ae0037d4
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Tue Sep 5 13:58:31 2023 -0700
Adds auto release workflow (#1003)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 327c141e9b70465b1760f9ebf8c001a2e439b01f
Author: Jackie Han <hnyng@amazon.com>
Date: Fri Sep 1 13:00:23 2023 -0700
Revert "Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards (#948)" (#999)
This reverts commit bc1649922ef39619424fc16c64af5836e48a4a12.
commit 4a09b741e1c127a92775cb55f4c56aa5c4f3f6a3
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Aug 21 11:21:36 2023 -0700
Update Gradle Wrapper to 8.2.1 for Enhanced JDK20 Compatibility (#985)
- **Reason for Upgrade**: The migration to JDK20 ([reference](https://github.com/opensearch-project/opensearch-build/blob/aa65a8ecd69f77c3d3104043dd1c48dff708bffa/manifests/3.0.0/opensearch-3.0.0.yml#L9)) rendered the current Gradle version (7.6.1) incompatible.
- **Actions Taken**:
- **Gradle Wrapper Update**: Upgraded the Gradle wrapper to version 8.2.1 to maintain compatibility with JDK20. The gradle wrapper files are generated using the `./gradlew wrapper` command.
- Applied `spotless` due to new formatting requirements in Gradle 8.
- Resolved test "jar hell" issues. Gradle 8 introduced internal JARs to the test classpath that conflicted with dependencies from `org.junit.vintage:junit-vintage-engine`. As a remedy, these conflicting JARs have been excluded.
- **Relevant Pull Requests**:
- [Alerting#893](https://github.com/opensearch-project/alerting/pull/893/files)
- [ML-Commons#892](https://github.com/opensearch-project/ml-commons/pull/892)
- [Security PR](https://github.com/opensearch-project/security/pull/2978)
- **Verification**: Successfully verified the changes using `gradle build`.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 5ac6390e7de643d8177f0a5833995032f3a279ad
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Aug 17 11:08:36 2023 -0700
Refactoring task cache manager for forecasting (#982)
* Refactoring Shared Functionality for Broader Task Compatibility
This PR extracts shared components from `ADTaskCacheManager` into `TaskCacheManager` to support the requirements of the forecasting feature.
**Renamings**:
- **Method-level in `ADTaskCacheManager`**:
- `addDeletedDetector` to `addDeletedConfig`
- `addDeletedDetectorTask` to `addDeletedTask`
- `hasDeletedDetectorTask` to `hasDeletedTask`
- `pollDeletedDetector` to `pollDeletedConfig`
- `pollDeletedDetectorTask` to `pollDeletedTask`
- **Variable-level in `AnomalyDetectorSettings`**:
- `CHECKPOINT_MAINTAIN_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_MAINTAIN_QUEUE_MAX_HEAP_PERCENT`
- `CHECKPOINT_READ_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_READ_QUEUE_MAX_HEAP_PERCENT`
- `CHECKPOINT_SAVING_FREQ` to `AD_CHECKPOINT_SAVING_FREQ`
- `CHECKPOINT_TTL` to `AD_CHECKPOINT_TTL`
- `CHECKPOINT_WRITE_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_WRITE_QUEUE_MAX_HEAP_PERCENT`
- `COLD_ENTITY_QUEUE_MAX_HEAP_PERCENT` to `AD_COLD_ENTITY_QUEUE_MAX_HEAP_PERCENT`
- `DEDICATED_CACHE_SIZE` to `AD_DEDICATED_CACHE_SIZE`
- `ENTITY_COLD_START_QUEUE_CONCURRENCY` to `AD_ENTITY_COLD_START_QUEUE_CONCURRENCY`
- `ENTITY_COLD_START_QUEUE_MAX_HEAP_PERCENT` to `AD_ENTITY_COLD_START_QUEUE_MAX_HEAP_PERCENT`
- `EXPECTED_COLD_ENTITY_EXECUTION_TIME_IN_MILLISECS` to `AD_EXPECTED_COLD_ENTITY_EXECUTION_TIME_IN_MILLISECS`
- `FILTER_BY_BACKEND_ROLES` to `AD_FILTER_BY_BACKEND_ROLES`
- `MAX_ENTITIES_PER_QUERY` to `AD_MAX_ENTITIES_PER_QUERY`
- `MAX_MODEL_SIZE_PER_NODE` to `AD_MAX_MODEL_SIZE_PER_NODE`
- `MAX_MULTI_ENTITY_ANOMALY_DETECTORS` to `AD_MAX_HC_ANOMALY_DETECTORS`
- `MAX_RETRY_FOR_END_RUN_EXCEPTION` to `AD_MAX_RETRY_FOR_END_RUN_EXCEPTION`
- `MAX_SINGLE_ENTITY_ANOMALY_DETECTORS` to `AD_MAX_SINGLE_ENTITY_ANOMALY_DETECTORS`
- `MODEL_MAX_SIZE_PERCENTAGE` to `AD_MODEL_MAX_SIZE_PERCENTAGE`
- `PAGE_SIZE` to `AD_PAGE_SIZE`
- `RESULT_WRITE_QUEUE_MAX_HEAP_PERCENT` to `AD_RESULT_WRITE_QUEUE_MAX_HEAP_PERCENT`
- **Class-level**:
- `ADRealtimeTaskCache` renamed to `RealtimeTaskCache`
- **Package-level**:
- Shifted from `org.opensearch.ad.breaker` to `org.opensearch.timeseries.breaker`
**Migrations**:
- Variables transferred from `AnomalyDetectorSettings` to `TimeSeriesSettings`:
- `BATCH_BOUNDING_BOX_CACHE_RATIO`
- `CHECKPOINT_MAINTAIN_REQUEST_SIZE_IN_BYTES`
- `CHECKPOINT_WRITE_QUEUE_SIZE_IN_BYTES`
- `DEFAULT_AD_JOB_LOC_DURATION_SECONDS` (renamed to `DEFAULT_JOB_LOC_DURATION_SECONDS`)
- `ENTITY_REQUEST_SIZE_IN_BYTES`
- `HOURLY_MAINTENANCE`
- `INTERVAL_RATIO_FOR_REQUESTS`
- `LOW_SEGMENT_PRUNE_RATIO`
- `MAINTENANCE_FREQ_CONSTANT`
- `MAX_COLD_START_ROUNDS`
- `MAX_QUEUED_TASKS_RATIO`
- `MAX_TOTAL_RCF_SERIALIZATION_BUFFERS`
- `MAX_CHECKPOINT_BYTES`
- `MEDIUM_SEGMENT_PRUNE_RATIO`
- `NUM_MIN_SAMPLES`
- `NUM_SAMPLES_PER_TREE`
- `NUM_TREES`
- `QUEUE_MAINTENANCE`
- `RESULT_WRITE_QUEUE_SIZE_IN_BYTES`
- `SERIALIZATION_BUFFER_BYTES`
- `THRESHOLD_MIN_PVALUE`
- `TIME_DECAY`
**Deletions**:
- Obsolete settings and methods:
- `DESIRED_MODEL_SIZE_PERCENTAGE` in `AnomalyDetectorSettings`
- `getDesiredModelSize` in `MemoryTracker`
**Modifications**:
- `MemoryTracker` enums renamed for clear differentiation between real-time and historical memory usage, adding `REAL_TIME_FORECASTER` for a harmonized single-stream and HC analysis approach.
**Tests**:
- Changes validated with a successful Gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 0c5b4b94cb5b192160463fa8a5f58eac587fe95d
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Aug 15 13:09:17 2023 -0700
Update RCF to v3.8 and Enable Auto AD with 'Alert Once' Option (#979)
* Update RCF to v3.8 and Enable Auto AD with 'Alert Once' Option
This PR added support for automatic Anomaly Detection (AD) and the 'Alert Once' option introduced in RCF 3.8.
Testing done:
1. Deserialization Test:
* Verified model deserialization from 3.0-rc3.
* Ensured consistent scoring using the rc3 checkpoint and rc3 dependency on identical data.
2. Backward Compatibility Test:
* Executed a mixed cluster with versions 2.10 and 3.0.
* Validated that older detectors still produce results without throwing any exceptions in a blue-green simulation scenario.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* reduce recall since alertOnce reduced recall
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* remove commented out code
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit cadc9bbd949daf4f2669335bfb8629e2137c108d
Author: Joshua Palis <jpalis@amazon.com>
Date: Fri Aug 11 16:02:38 2023 -0700
Fixing imports, adding TermsAggregator BucketCountThresholds for StringTerms, setting AnomalyResult grade to 0 if negative value (#976)
Signed-off-by: Joshua Palis <jpalis@amazon.com>
commit 3985cd2f82f2cfa57604ecf5a512bb042e632cae
Author: Romain Tartière <romain@blogreen.org>
Date: Wed Aug 9 08:59:30 2023 -1000
Fix build with latest OpenSearch (for real this time) (#972)
This is a follow-up to #971, where commit
2839bc2c6f470639b68901086c80cb2152d96558 only fixed _some_ but not _all_
of the build errors (it allowed `./gradlew run` to pass but `./gradlew
build` was failing).
Fix the build errors when we run `./gradlew build`.
Signed-off-by: Romain Tartière <romain@blogreen.org>
commit 2839bc2c6f470639b68901086c80cb2152d96558
Author: Romain Tartière <romain@blogreen.org>
Date: Tue Aug 8 13:15:04 2023 -1000
Fix build with latest OpenSearch (#971)
OpenSearch recently merged some code that cause buid failure for this
module, as spotted in #585.
This change the import to match the new one after
https://github.com/opensearch-project/OpenSearch/pull/9103
Signed-off-by: Romain Tartière <romain@blogreen.org>
commit d4946f04e7ad44f0bc79215962c6678786c592ff
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Aug 7 14:21:56 2023 -0700
Refactor ADTask and Related Components (#969)
* Refactor ADTask and Related Components
This PR includes several key refactoring changes:
- Extracts common code from ADTask into TimeSeriesTask, creating ForecastTask for forecasting-specific logic.
- Consolidates common code from ADTaskType into TaskType and introduces ForecastTaskType for forecasting-related purposes.
- Renames ADTaskState to TaskState for consistent code reuse.
- Renames the method getId in ADTask to getConfigId to differentiate it from other IDs like task id.
Testing done:
1. Added unit tests for the new code to ensure functionality.
2. Executed a successful Gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* add comments and address compiler errors
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Amit's comments and address compiler failure
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 1130a1ba6fc3c08f375dd99f98e93e4ee36331fb
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jul 27 10:39:39 2023 -0700
Refactoring NodeStateManager etc. to support forecasting functionality (#965)
* Refactoring NodeStateManager etc. to support forecasting functionality
This commit extends the codebase to support both Anomaly Detection (AD) and forecasting. It contains a mixture of refactoring, renaming, removal of unused code, and package moving tasks. Here are the details:
Refactoring:
- `NodeStateManager.getAnomalyDetector` is now `getConfig`, with added functionality to fetch a Forecaster. The method comments are updated for clarity.
- Existing methods (`getFeatureSamplesForPeriods`, `getColdStartSamplesForPeriods`, `createPreviewSearchRequest`, `getMinDataTime`) have been added in `SearchFeatureDao` to handle forecasting logic.
- Adjusted `SecurityClientUtil` and `ParseUtils` to handle forecasting logic.
- Cleaned up `NodeState` to differentiate state for AD and forecasting.
Renaming:
- `AnomalyDetectorJob` is renamed to `Job` to facilitate reuse for forecasting.
- `NodeStateManager.getAnomalyDetectorJob` is renamed to `getJob`.
- Certain settings in `AnomalyDetectorSettings` are renamed to reflect they are meant for the AD setting. They have been marked as deprecated and new settings are used in `TimeSeriesSettings` instead.
- `IndexAnomalyDetectorJobActionHandler.getAnomalyDetectorJobForWrite` is renamed to `getJobForWrite`.
- `ADSafeSecurityInjector` is renamed to `TimeSeriesSafeSecurityInjector`.
Removing unused code:
- Synchronous code in `ClientUtil`, `IndexUtils`, and `CheckpointDao` is removed.
- The unused class `Throttler` is deleted.
- Mapping file names are changed, and the code referencing these files is adjusted.
Package moving:
- Several classes (`ClientUtil`, `MultiResponsesDelegateActionListener`, `SafeSecurityInjector`, `SecurityUtil`, `ExceptionUtil`, `SearchFeatureDao`, `CleanState`, `ExpiringState`, `MaintenanceState`, `NodeState`, `SingleStreamModelIdMapper`, `BackPressureRouting`) are moved to the respective `org.opensearch.timeseries` packages.
Miscellaneous:
- Fixed compiler failures caused by changes in https://github.com/opensearch-project/OpenSearch/pull/8730 by replacing `DoubleArrayList` with `java.util.ArrayList`.
- Updates the Backwards Compatibility (bwc) version to align with the core's incremented bwc version as per [OpenSearch PR #8670](https://github.com/opensearch-project/OpenSearch/pull/8670). This change prevents the issue described in [OpenSearch Issue #5076](https://github.com/opensearch-project/OpenSearch/issues/5076).
Testing:
- Executed a `gradle build`.
- Added new tests for `ClientUtil` and `NodeStateManager`.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comment
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* fix compiler error and comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit f0ed43b1aa3c5d80dc6f23a5dd4465bb03ef1739
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jul 17 15:18:03 2023 -0700
Rename AD to time series analytics & Resolve Compiler Errors (#951)
This commit focuses on renaming the AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin as well as addressing compiler errors due to package import changes. The primary transformations are:
* Renamed AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin.
* Updated all references from AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin.
* Amended plugin information in build.gradle and src/main/resources/es-plugin.properties.
* Switched job type in TimeSeriesAnalyticsPlugin from opendistro_anomaly_detector to opensearch_time_series_analytics.
These changes led to the modification of our plugin binary from opensearch-anomaly-detection-3.0.0.0-SNAPSHOT.jar to opensearch-time-series-analytics-3.0.0.0-SNAPSHOT.jar.
Moreover, following changes from OpenSearch Pull Request #8157, compiler errors were encountered, which were resolved by updating the import packages
* org.opensearch.common.io.stream.NamedWriteableRegistry => org.opensearch.core.common.io.stream.NamedWriteableRegistry
* org.opensearch.common.xcontent.XContentParserUtils => * org.opensearch.core.xcontent.XContentParserUtils
* org.opensearch.common.bytes.BytesArray => org.opensearch.core.common.bytes.BytesArray * org.opensearch.common.io.stream.StreamInput => * org.opensearch.core.common.io.stream.StreamInput ** org.opensearch.common.io.stream.StreamOutput => org.opensearch.core.common.io.stream.StreamOutput
* org.opensearch.common.io.stream.Writeable => org.opensearch.core.common.io.stream.Writeable
* org.opensearch.common.io.stream.NotSerializableExceptionWrapper => org.opensearch.core.common.io.stream.NotSerializableExceptionWrapper
* org.opensearch.rest.RestStatus => org.opensearch.core.rest.RestStatus
* org.opensearch.common.ParsingException => org.opensearch.core.common.ParsingException
* org.opensearch.common.bytes.BytesReference => org.opensearch.core.common.bytes.BytesReference
* org.opensearch.common.io.stream.InputStreamStreamInput => org.opensearch.core.common.io.stream.InputStreamStreamInput
* org.opensearch.common.io.stream.OutputStreamStreamOutput => org.opensearch.core.common.io.stream.OutputStreamStreamOutput
* org.opensearch.index.shard.ShardId => org.opensearch.core.index.shard.ShardId* org.opensearch.index.Index => org.opensearch.core.index.Index
* org.opensearch.core.index.IndexNotFoundException => org.opensearch.index.IndexNotFoundException
Validation steps were executed to ensure these changes did not break functionality:
* gradle build was successful. A local build was required due to outdated OpenSearch and job scheduler nightly builds.
* Backward compatibility tests were performed on a two-node 2.9 cluster running some detectors. These detectors continued to produce results on a 3.0 cluster with these updates.
* I can start new detectors on the 3.0 node.
* After shutting down a 2.9 node, the job transfer to the 3.0 node was successful and the job continued to perform as expected.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit c7c6a46e88e15f615fc9dae0499cf0d674662057
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Thu Jul 13 15:42:46 2023 -0700
Add 2.9 release notes (#952)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit bc1649922ef39619424fc16c64af5836e48a4a12
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Jul 11 13:34:09 2023 -0700
Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards (#948)
* Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards
In this PR, we temporarily enforce DOCUMENT replication for AD indices. This change is necessary due to the current limitation of SegRep, which doesn't support Get/MultiGet by ID. This measure will be in place until SegRep adds support for these operations.
This adjustment aligns with the modification made in the referenced PR: job-scheduler PR #417
Additionally, this PR increases the number of primary shards for forecasting indices from 10 to 20, recognizing the higher write intensity of these indices. For instance, when the horizon is 24, we are expected to save 25 documents: 24 for each forecast and 1 for the actual value. In contrast, for AD, we save one document per actual value.
Testing done:
1. gradle build passed
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Fix comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit a1203827617ee42b35d41cb8b010719f334f73b7
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jul 10 10:53:17 2023 -0700
Add ForecastResult and Refactor Shared Code (#941)
This commit adds the functionality of ForecastResult, while also performing several necessary refactorings.
Firstly, we introduce ForecastResult, which closely mirrors the functionality of AnomalyResult. Any shared code between these two classes has been abstracted out into a new parent class, IndexableResult. This refactoring was undertaken to facilitate code reuse and improve maintainability, as both classes deal with storing fields that need to be saved in result indices.
Secondly, we've also extracted common code from ThresholdingResult into another new class, IntermediateResult. This work is in preparation for a forthcoming PR which will introduce RCFCasterResult. In this change, we moved the 'toAnomalyResult' method to IndexableResult, and renamed it to 'toIndexableResults'. This renaming allows for reuse in the upcoming RCFCasterResult. The updated method now returns a list of results instead of a single result. The shift caters for the RCFCasterResult use case where one RCFCasterResult is stored across multiple ForecastResult documents.
Furthermore, this commit modifies the 'entity' field in several methods to be of the Optional type, indicating that it can be empty. This change provides a clear signal to other developers about the optional nature of these fields.
In addition, this commit updates the mapping for the forecast result index. The prior mapping was a placeholder and this change brings it up to date.
We've also moved to using httpcore5 and httpclient5 versions from OpenSearch core, as necessitated by recent changes in [OpenSearch PR #8434](https://github.com/opensearch-project/OpenSearch/pull/8434/files). This shift resolves potential jar hell issues with httpcore5 and httpclient5.
Lastly, we've made name and package changes:
1. Renamed 'initDetectionStateIndex' in ADIndexManagement to 'initStateIndex' to align with ForecastIndexManagement naming.
2. Moved the 'DataByFeatureId' class to the 'timeseries' package for better organization.
This commit also completes the 'createDummyIndexRequest' method in ForecastIndexManagement by invoking 'ForecastResult.getDummyResult()', which is now possible due to the introduction of the ForecastResult implementation.
Testing done:
1. added tests for new code
2. gralde build passes
3. e2e tests
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit f24d9e32ff739abf29cac3da15fd00f74219e213
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Thu Jul 6 17:28:09 2023 -0700
Bump scipy from 1.8.0 to 1.10.0 in /dataGeneration (#943)
Bumps [scipy](https://github.com/scipy/scipy) from 1.8.0 to 1.10.0.
- [Release notes](https://github.com/scipy/scipy/releases)
- [Commits](https://github.com/scipy/scipy/compare/v1.8.0...v1.10.0)
---
updated-dependencies:
- dependency-name: scipy
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 9b9fd2ba3f3e678d717c0a45af8069bb67828808
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Jun 27 16:08:55 2023 -0700
bump guava version to 32.0.1 (#933)
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit 99749dfa6bfc8a2f2c4660ca01d75d1ad57124a5
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jun 26 16:46:24 2023 -0700
Refactoring Index Creation for Improved Code Reuse and Consistency (#932)
This Pull Request significantly refactors the index creation module to promote greater code reusability and consistency. The primary changes are outlined as follows:
1. Code Migration: Common code segments have been moved from AnomalyDetectionIndices to IndexManagement. In addition, component-specific code has been established in ADIndexManagement and ForecastIndexManagement. The bulk of changes are concentrated in these three classes, with the remainder of the modifications relating to reference/test changes.
2. Function Renaming: Several functions have been renamed for broader applicability and consistency:
* AnomalyDetectorFunction has been renamed to ExecutorFunction for potential use in Forecasting.
* AnomalyDetectorSettings.MAX_PRIMARY_SHARDS has been renamed to AnomalyDetectorSettings.AD_MAX_PRIMARY_SHARDS in light of the new ForecastSettings.FORECAST_MAX_PRIMARY_SHARDS.
* doesAnomalyDetectorJobIndexExist() has been renamed to doesJobIndexExist() to allow for job index reusability across Anomaly Detection (AD) and forecasting. Analogous changes have been made to other job index-related functions.
* doesAnomalyDetectorIndexExist() has been renamed to doesConfigIndexExist() to allow for config index reusability across AD and forecasting. Analogous changes have been made to other config index-related functions.
* detectionIndices.doesDetectorStateIndexExist() has been renamed to detectionIndices.doesStateIndexExist(), as the former name was unnecessarily redundant. Similar modifications have been made to the result and checkpoint index.
3. Class Migration: The classes ThrowingSupplierWrapper, ThrowingConsumer, and ThrowingSupplier have been moved from org.opensearch.ad.util to org.opensearch.timeseries.function to promote code reuse.
4. Initial Forecast Indices' Mapping: An initial version of forecast indices' mapping has been added, which can be adjusted as required in the future.
5. In terms of version updates, 2.x has been bumped to 2.9, prompting an increment of the Backward Compatibility (BWC) test version to 2.9.
6. Update dependency com.google.guava:guava to v32 for cve fix.
Testing done:
Testing has been performed with new tests added for forecast index creation, and the grade build passes successfully.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit aedb781a6b1df984636d72d50b65d41138539918
Author: Craig Perkins <craig5008@gmail.com>
Date: Tue Jun 20 16:55:19 2023 -0400
Fix main build - update import of Releasable and remove reference to BaseExceptionsHelper (#930)
* Fix main build - update import of Releasable and remove reference to BaseExceptionsHelper
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update imports in test classes
Signed-off-by: Craig Perkins <cwperx@amazon.com>
---------
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit fce78c29c0375ae06f56e16c85fb98933401e28f
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Jun 14 10:36:40 2023 -0700
Refactor: Reorganize code for Forecasting and AnomalyDetector packages (#925)
* Refactor: Reorganize code for Forecasting and AnomalyDetector packages
This PR includes several refactorings to increase code reuse and improve readability:
1. Entity, FeatureData, and RestHandlerUtils have been moved from the 'ad' package to the 'timeseries' package, enabling their use within the Forecasting code.
2. A new class, DataByFeatureId, has been created to hold shared code previously located in FeatureData. FeatureData now inherits from DataByFeatureId. The standalone usage of DataByFeatureId will be detailed in subsequent PRs.
3. Renamed checkAnomalyDetectorFeaturesSyntax to checkFeaturesSyntax in RestHandlerUtils to make it more generic and usable for Forecasting.
4. Constants AGG_NAME_MAX_TIME, AGG_NAME_MIN_TIME, DATE_HISTOGRAM, and FEATURE_AGGS have been moved from ADCommonName to CommonName to make them accessible for Forecasting.
5. A new method, parseConfig, has been added to the Config class. This method can parse configuration for either AnomalyDetector or Forecaster based on input.
Testing:
The changes have been validated with a successful gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Amit and Owais's comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 02c120f025f73f3d45a8477c7ef8b4873befebfa
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jun 12 11:54:39 2023 -0700
Updated Maintainers and CODE_OWNERS list (#926)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 2ea4dcf430b40a710a0babb04881eeff9fb2d689
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jun 8 15:11:44 2023 -0700
Add Forecaster class (#920)
* Add Forecaster class
This PR adds class Forecaster that serves as the configuration POJO for forecasting. Shared code between AnomalyDetector and Forecaster is extracted and moved to the Config class to reduce duplication and promote reusability. References to the common code in related classes have also been adjusted.
Testing done:
1. gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* fix compiler error due to a recent core change
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Sudipto and Amit's comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit ee04225349a5f0f003d56e77a3243386f4a9673d
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri Jun 2 15:42:19 2023 -0700
Refactor: Migrate files from 'ad' to 'timeseries' package (#918)
* Refactor: Migrate files from 'ad' to 'timeseries' package
This commit involves moving various files from the 'ad' package to the 'timeseries' package. All changes to dependent imports were handled automatically through the IDE, and no changes to file contents were made in the process.
Testing done:
- gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* move ParseUtils to util package
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 472868d165c2234eece8827584f64086aaf7ae92
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jun 1 11:17:16 2023 -0700
Refactor Shared Settings, Introduce Dynamic Forecast Settings, Rename (#912)
* Refactor Shared Settings, Introduce Dynamic Forecast Settings, and Rename Checkpoint mapping File
This commit has undertaken three changes:
* Refactoring of Shared Settings: I've performed a refactoring to unify the settings that are shared between the AD and forecasting modules.
* Introduction of Dynamic Forecast Settings: To increase the adaptability of our system, I've implemented dynamic forecast settings. These settings mirror the existing structure of the AD dynamic settings and will enable us to adjust forecast settings on-the-fly.
* Renaming of Checkpoint File: To enhance the consistency across our AD mapping files, I've renamed checkpoint.json to anomaly-checkpoint.java.
Testing done:
1. added tests for new settings.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* name change and delete files
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 04ab91e60e9d71765a7b9df10b86e0e53ba4d715
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 31 12:18:54 2023 -0700
add 2.8 release notes (#915)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 98da8dffe8d336793ae35658015650b0f83aeef1
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 24 14:37:38 2023 -0700
Implementing Multiple Imputation Methods for Missing Values (#907)
* Implementing Multiple Imputation Methods for Missing Values
This Pull Request introduces multiple imputation methods to handle missing data in Anomaly Detection (AD) and forecasting. The ability to handle missing data is crucial to improve the robustness and accuracy of our models.
The following imputation methods have been implemented:
* Zero Imputation (ZERO): This method replaces all missing values with 0's. It's a simple approach, but it may introduce bias if the data is not centered around zero.
* Fixed Values Imputation (FIXED_VALUES): This method replaces missing values with a predefined set of values. The values are the same for each input dimension, and they need to be specified by the user.
* Previous Value Imputation (PREVIOUS): This method replaces missing values with the last known value in the respective input dimension. It's a commonly used method for time series data, where temporal continuity is expected.
* Linear Interpolation (LINEAR): This method estimates missing values by interpolating linearly between known values in the respective input dimension. This method assumes that the data follows a linear trend.
These methods are designed to provide a set of options for users to handle missing data based on their specific needs and the nature of their data.
Testing Done:
The code changes in this pull request have been validated through a gradle build to ensure that all new and existing tests pass successfully.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Various changes
The commit makes all new files use the shortened header text and addresses compiler/test issues due to core refactoring
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit da608aaa3d3f955efe32b0cb33b3c8cfdd7a7718
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue May 16 11:37:34 2023 -0700
Code Refactoring for CommonMessages (#902)
* Code Refactoring for CommonMessages
In this pull request, I have refactored the code related to shared log or error messages in both AD and forecasting modules to CommonMessages. Additionally, the previously used CommonErrorMessages has been renamed to ADCommonMessages. For the Forecasting module, I have introduced new names in ForecastCommonMessages.
Testing done:
* gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Update string constants wording
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve wording and remove redundant variables
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 041d6ce73d37f1697013b2d2f0683fbfe012247c
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri May 12 13:05:56 2023 -0700
Code Refactoring for CommonName (#901)
In this pull request, I have refactored the code related to shared names in both AD and forecasting modules to CommonNames. Additionally, the previously used CommonName has been renamed to ADCommonName. For the Forecasting module, I have introduced new names in ForecastCommonNames.
Testing done:
* gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit e2fee9d6ba59cc2a23eadbb50a80414fcc7dbf8f
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 10 17:26:31 2023 -0700
Update outdated MAINTAINERS and OWNERS list (#898)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 98b566d1ec57ffd8970b5180c54b493deb1a24ac
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Wed May 10 18:03:04 2023 -0400
Sync up CODEOWNERS with MAINTAINERS.md. (#897)
Signed-off-by: dblock <dblock@amazon.com>
commit 1f8415aa39fa4ec3ba016214255aa0e79b7c7d63
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue May 9 12:55:35 2023 -0700
Various fixes (#886)
* Various fixes
This pull request addresses several issues related to the compiler and tests in the current main branch.
The first major change involves replacing ImmutableOpenMap with java.util.Map in the core. This modification is implemented in the following pull requests:
https://github.com/opensearch-project/OpenSearch/pull/7165
https://github.com/opensearch-project/OpenSearch/pull/7301
To accommodate this change, the codebase of the AD (Anomaly Detection) module has been refactored to utilize JDK maps. As a consequence of this change, passing null to the custom parameters of ClusterState is no longer permissible, as it leads to a NullPointerException. The error stack trace is as follows:
java.lang.NullPointerException: Cannot invoke "Object.getClass()" because "m" is null
at __randomizedtesting.SeedInfo.seed([60CDDB34427ACD0C:6E72DB4ED18E018D]:0)
at java.base/java.util.Collections.unmodifiableMap(Collections.java:1476)
at org.opensearch.cluster.ClusterState.<init>(ClusterState.java:219)
at org.opensearch.ad.transport.DeleteAnomalyDetectorTests.createClusterState(DeleteAnomalyDetectorTests.java:216)
at org.opensearch.ad.transport.DeleteAnomalyDetectorTests.testDeleteADTransportAction_LatestDetectorLevelTask(DeleteAnomalyDetectorTests.java:160)
To address this issue, we have replaced the usage of null with new HashMap<>().
The second change in this pull request aligns with the modifications introduced in PR https://github.com/opensearch-project/anomaly-detection/pull/878.
The third issue is related to the incompatibility between tests that utilize the @Parameters annotation and those that do not, as explained in https://tinyurl.com/2y265s2w. Specifically, the SearchFeatureDaoTests class runes tests with the @Parameters annotation, whereas SearchFeatureDao tests do not.
Testing done:
1. gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 0a48da9e1a0cd70c64cc2da228674baaf377c89e
Author: Jackie Han <hnyng@amazon.com>
Date: Mon Apr 17 12:44:06 2023 -0700
Add 2.7 release notes (#871)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 1edc2ef1ccfe20938711984744b20d1f2ec96a3c
Author: Jackie Han <hnyng@amazon.com>
Date: Tue Apr 11 17:53:57 2023 -0700
Update OpenSearchRejectedExecutionException import (#861)
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update NodeInfo constructor and javadoc for isAdmin method
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit b8df172c2364997c446096e960068d6fc5d2e6f6
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Apr 11 10:55:28 2023 -0700
Giving admin priority over backendrole filtering (#850)
* giving admin priority over backend role filtering
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
* fix security tests
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
* remove redundent line in test case
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
---------
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit fd2fd5d5f63c9004b9f265e3c1e4475282447da8
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Thu Mar 16 14:30:32 2023 -0400
Created untriaged issue workflow. (#809)
Signed-off-by: dblock <dblock@amazon.com>
commit fd547014fdde5114bbc9c8e49fe7aaa37eb6e793
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Mar 1 16:41:05 2023 -0800
Publish snapshots to maven via GHA, fix spotless errors, and bump bwc version (#827)
We are de-coupling the task of publishing the maven snapshots from centralized build workflow to individual repositories. This PR publishes maven snapshots using GitHub Actions.
Testing done:
1. ran ./gradlew publishPluginZipPublicationToSnapshotsRepository according to https://github.com/opensearch-project/anomaly-detection/issues/813
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit b6be5960fb8cff41f0e9d13d5f5a971c289b80ed
Author: Jackie Han <hnyng@amazon.com>
Date: Thu Feb 23 12:23:01 2023 -0800
Update xcontent imports (#822)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 1dcb78a6c4d1331133aefe5af7adf137daa8846f
Author: Jackie Han <hnyng@amazon.com>
Date: Wed Feb 22 11:17:21 2023 -0800
Add 2.6 release note (#818)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 553688aae45590c37cc4d86102642d0b3a6ebb33
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Feb 9 13:38:14 2023 -0800
Revert changes to exception message (#803)
* Revert changes to exception message
We used to log "No RCF models are available either because RCF models are not ready..." and now we log "resource_not_found_exception: No checkpoints found for model id...". This change caused an integration test failure. This PR reverts it back.
Testing done:
1. verified that the original log is back.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* check NO_MODEL_ERR_MSG instead of NO_CHECKPOINT_ERR_MSG
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit c9bdc628a03c4ced3cd1ebeec44ebff792d7ff98
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri Feb 3 11:15:37 2023 -0800
fixing dls/fls logic around numeric aggregations (#801)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 9cebc5bc97a84dd78ac8892863ff7d674428bced
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Jan 10 02:17:04 2023 +0000
adding 2.5 release notes
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit 2ace84643fd199a5e5179e6d21ab76ae212cb7d8
Author: Ryan Bogan <10944539+ryanbogan@users.noreply.github.com>
Date: Tue Jan 10 13:31:49 2023 -0800
Add jackson back to build.gradle (#780)
Signed-off-by: Ryan Bogan <rbogan@amazon.com>
commit a5d60eefab5ac30ef5243da8e7a88b7a2189cd5c
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jan 9 15:49:35 2023 -0800
bump bwc to 2.6.0 (#775)
We need to bump the version because only the latest 2.x will be upgradable to 3.0 when that ship. Since OpenSearch core bumped to 2.6, we need to do that as well. Note after bumping version, bwc still fails to find 2.6.0 core zip.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 27ed49863bfbef90551cdfacc6b51703bf622e25
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jan 9 12:17:57 2023 -0800
Fix the discrepancy between Profile API and real time tasks API (#770)
* Fix the discrepancy between Profile API and real time tasks API
This PR fixes the discrepancy by querying the result index when the total updates is less than 32. We have done similar things in profile API so I refactored reusable code to ProfileUtil. We also cached whether we have queried the result index and won't repeatedly issue the extra query.
Testing done:
1. repeated repro steps in https://github.com/opensearch-project/anomaly-detection/issues/502 and verified the issue has been resolved.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit b49a36b3e7962a205695d451e0497ee4f57fb2cb
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Thu Jan 5 10:19:51 2023 -0800
Updated MAIN…
kaituo
added a commit
to kaituo/anomaly-detection-1
that referenced
this pull request
Mar 27, 2024
commit 303ceb5b320f148dcd015ab6a11f870ae3e23125
Author: Joshua Palis <jpalis@amazon.com>
Date: Mon Mar 18 16:49:59 2024 -0700
Adding 2.13 release notes (#1170)
Signed-off-by: Joshua Palis <jpalis@amazon.com>
commit 1507dd4b4045bd8e8cdf505d07041ce304788ca0
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Feb 21 15:59:34 2024 -0800
Inject NamedWriteableRegistry in AD node client (#1164)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 5b85720d442d1b43001dde0c20248fd4a20a64b0
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Tue Feb 13 10:20:20 2024 -0800
Fixed lucene url (#1158)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 290bdcd832a0cae6d039787d9f0af73ea6be2ec2
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Feb 6 16:14:49 2024 -0800
add 2.12 release notes (#1152)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 6a6eec347379c997f0f7acc88b027bc1ffdd8f54
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Tue Jan 30 18:20:36 2024 -0800
Add ser/deser to get AD transport action request (#1150)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 475f0c36e5b6267aaeb101627b9c3ae1fcca3a88
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Thu Jan 25 14:37:12 2024 -0800
Updated lucene snapshot url (#1146)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 7192d848d2923566a409901909f342a63695e1c2
Author: Jackie Han <hnyng@amazon.com>
Date: Thu Jan 25 09:48:37 2024 -0800
Remove default admin credentials (#1134)
* Remove default admin credentials
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Replace default password with a placeholder in README files
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 97482c19b0eded34a7f435e589303a834c258aa3
Author: Jackie Han <hnyng@amazon.com>
Date: Wed Jan 24 09:39:55 2024 -0800
Require JDK version for java spotless check (#1129)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 708e0462189677a217b35905c2feba5486c77cdc
Author: Andriy Redko <andriy.redko@aiven.io>
Date: Tue Jan 23 15:11:39 2024 -0500
Update to Jackson 2.16.1 (#1135)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
commit 7c0ce4cb554a05230ecf5365b903219f357997bf
Author: Andriy Redko <drreta@gmail.com>
Date: Tue Jan 16 17:51:37 2024 -0500
Update to Gradle 8.5 (#1131)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
commit e5cbe93c0e9cadebe2a30cba83f99ae8a3f8fe57
Author: zane-neo <zaniu@amazon.com>
Date: Thu Jan 4 16:50:47 2024 +0800
add publishToMavenLocal task to fix zip plugin not pulished to maven local issue when running this script (#1121)
Signed-off-by: zane-neo <zaniu@amazon.com>
commit 106dc25b3ef36beae329dc7882bcdf9c23347fb5
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Dec 27 16:33:25 2023 -0800
Refactor client's getDetectorProfile to use GetAnomalyDetectorTransportAction (#1124)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 59b4ebecfa11cac977f49c999ce85637fb6fac58
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Dec 27 11:56:00 2023 -0800
Add profile transport action to AD client (#1119)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 29711f96dbb2c9abc1181b933a8b334eed63ca66
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Tue Dec 12 08:32:53 2023 -0800
Add an AD transport client (#1110)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 353dcaeb05f8b75fa74d92e2ae8415ab018bc68e
Author: Daniel Widdis <widdis@gmail.com>
Date: Wed Nov 22 13:59:53 2023 -0800
Fix build, update CVE-affected versions (#1102)
* Fix build, update CVE-affected versions
Signed-off-by: Daniel Widdis <widdis@gmail.com>
* Spotless depends on CVE-impacted eclipse dependency, now needs JDK17+
Signed-off-by: Daniel Widdis <widdis@gmail.com>
---------
Signed-off-by: Daniel Widdis <widdis@gmail.com>
commit 4c6ba48bf9fb9234ad8bc0b9193f3c68409acfb9
Author: Peter Zhu <zhujiaxi@amazon.com>
Date: Mon Oct 30 19:35:01 2023 -0400
Fix the bwc test version retrieval (#1093)
* Onboarding jenkins prod docker images to github actions
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
---------
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
commit a1da3aa0eefc6671446d2eb3bc670bad6449d2f0
Author: Peter Zhu <zhujiaxi@amazon.com>
Date: Mon Oct 30 19:14:31 2023 -0400
Onboarding jenkins prod docker images to github actions (#1092)
* Onboarding jenkins prod docker images to github actions
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
---------
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
commit 040cd7e33f8e696ffe7748140c9b0ecc7475d513
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:43:02 2023 -0700
dependabot: bump net.bytebuddy:byte-buddy from 1.14.6 to 1.14.9 (#1081)
Bumps [net.bytebuddy:byte-buddy](https://github.com/raphw/byte-buddy) from 1.14.6 to 1.14.9.
- [Release notes](https://github.com/raphw/byte-buddy/releases)
- [Changelog](https://github.com/raphw/byte-buddy/blob/master/release-notes.md)
- [Commits](https://github.com/raphw/byte-buddy/compare/byte-buddy-1.14.6...byte-buddy-1.14.9)
---
updated-dependencies:
- dependency-name: net.bytebuddy:byte-buddy
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit dd9c1521bc1946027245d65e39a7844cdf04a8b7
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:42:15 2023 -0700
dependabot: bump aws-actions/configure-aws-credentials (#1076)
Bumps [aws-actions/configure-aws-credentials](https://github.com/aws-actions/configure-aws-credentials) from 1.7.0 to 4.0.1.
- [Release notes](https://github.com/aws-actions/configure-aws-credentials/releases)
- [Changelog](https://github.com/aws-actions/configure-aws-credentials/blob/main/CHANGELOG.md)
- [Commits](https://github.com/aws-actions/configure-aws-credentials/compare/v1.7.0...v4.0.1)
---
updated-dependencies:
- dependency-name: aws-actions/configure-aws-credentials
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit d6e3fd7a69b1daea45d7a455335e55b6de118033
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:05:00 2023 -0700
dependabot: bump com.netflix.nebula.ospackage from 11.0.0 to 11.5.0 (#1066)
Bumps com.netflix.nebula.ospackage from 11.0.0 to 11.5.0.
---
updated-dependencies:
- dependency-name: com.netflix.nebula.ospackage
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 57eacf611ce44559e14aa37f2e51dfbb82d53cc2
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:04:19 2023 -0700
dependabot: bump org.apiguardian:apiguardian-api from 1.1.0 to 1.1.2 (#1058)
Bumps [org.apiguardian:apiguardian-api](https://github.com/apiguardian-team/apiguardian) from 1.1.0 to 1.1.2.
- [Release notes](https://github.com/apiguardian-team/apiguardian/releases)
- [Commits](https://github.com/apiguardian-team/apiguardian/compare/r1.1.0...r1.1.2)
---
updated-dependencies:
- dependency-name: org.apiguardian:apiguardian-api
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 6b9faf2b71e5481be366b12bd6f16440c6c8ef89
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:04:01 2023 -0700
dependabot: bump org.junit.platform:junit-platform-launcher (#1056)
Bumps [org.junit.platform:junit-platform-launcher](https://github.com/junit-team/junit5) from 1.9.2 to 1.10.0.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/commits)
---
updated-dependencies:
- dependency-name: org.junit.platform:junit-platform-launcher
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 2a957f2086688b5ee76703406105797d31207cc5
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:03:11 2023 -0700
Bump urllib3 from 1.26.9 to 1.26.17 in /dataGeneration (#1068)
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.9 to 1.26.17.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.9...1.26.17)
---
updated-dependencies:
- dependency-name: urllib3
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit a12e33214f9c138946975801cefa2bd39c7978a9
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 11:29:37 2023 -0700
dependabot: bump org.objenesis:objenesis from 3.0.1 to 3.3 (#1040)
Bumps [org.objenesis:objenesis](https://github.com/easymock/objenesis) from 3.0.1 to 3.3.
- [Release notes](https://github.com/easymock/objenesis/releases)
- [Commits](https://github.com/easymock/objenesis/compare/3.0.1...3.3)
---
updated-dependencies:
- dependency-name: org.objenesis:objenesis
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 5a4ba14a431fbc53f757416542cda25ef2fae58c
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 11:28:46 2023 -0700
dependabot: bump tibdex/github-app-token from 2.0.0 to 2.1.0 (#1065)
Bumps [tibdex/github-app-token](https://github.com/tibdex/github-app-token) from 2.0.0 to 2.1.0.
- [Release notes](https://github.com/tibdex/github-app-token/releases)
- [Commits](https://github.com/tibdex/github-app-token/compare/v2.0.0...v2.1.0)
---
updated-dependencies:
- dependency-name: tibdex/github-app-token
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 713d556d980ccb144eb6ae952cebc7b3963ed28c
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 15:05:44 2023 -0700
dependabot: bump actions/setup-java from 1 to 3 (#1035)
Bumps [actions/setup-java](https://github.com/actions/setup-java) from 1 to 3.
- [Release notes](https://github.com/actions/setup-java/releases)
- [Commits](https://github.com/actions/setup-java/compare/v1...v3)
---
updated-dependencies:
- dependency-name: actions/setup-java
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 574ac521653ede84e7b821bc3c06049f1054a6ad
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 10:53:02 2023 -0700
dependabot: bump tibdex/github-app-token from 1.5.0 to 2.0.0 (#1042)
Bumps [tibdex/github-app-token](https://github.com/tibdex/github-app-token) from 1.5.0 to 2.0.0.
- [Release notes](https://github.com/tibdex/github-app-token/releases)
- [Commits](https://github.com/tibdex/github-app-token/compare/v1.5.0...v2.0.0)
---
updated-dependencies:
- dependency-name: tibdex/github-app-token
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 65e207aef49a6872408ae02e4f49cdd9060c1ef0
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 10:52:40 2023 -0700
dependabot: bump org.apache.commons:commons-pool2 from 2.10.0 to 2.11.1 (#1045)
Bumps org.apache.commons:commons-pool2 from 2.10.0 to 2.11.1.
---
updated-dependencies:
- dependency-name: org.apache.commons:commons-pool2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit a4ff71926af39726d9b4584102706e3ea7f4fa05
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:16:31 2023 -0400
React to Tracer changes in TransportService (#1034)
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 05d0a3b905cae9d25f6d5d91f30f1b842b9a792f
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:14:20 2023 -0400
Ensure integ tests run with security after plugin rename (#1023)
* Ensure integ tests run with security after plugin rename
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Rename to time-series-analytics
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Switch folder back
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Run integTest with -i
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Remove opensearch-anomaly-detection if installed
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update password rules and change expected error msg
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update password generation
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Fix indexOf condition
Signed-off-by: Craig Perkins <cwperx@amazon.com>
---------
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 72210f014ab54bf4a5b567ebe9dabe13b66c6cbb
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:39 2023 -0700
dependabot: bump codecov/codecov-action from 1 to 3 (#1038)
Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 1 to 3.
- [Release notes](https://github.com/codecov/codecov-action/releases)
- [Changelog](https://github.com/codecov/codecov-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/codecov/codecov-action/compare/v1...v3)
---
updated-dependencies:
- dependency-name: codecov/codecov-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit b77c3a7406e94424550ec1f22f084bc20533994f
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:14 2023 -0700
dependabot: bump com.google.guava:guava from 32.0.1-jre to 32.1.2-jre (#1037)
Bumps [com.google.guava:guava](https://github.com/google/guava) from 32.0.1-jre to 32.1.2-jre.
- [Release notes](https://github.com/google/guava/releases)
- [Commits](https://github.com/google/guava/commits)
---
updated-dependencies:
- dependency-name: com.google.guava:guava
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 18defcc16e81abe590e8f109d6df3c4a060f74ce
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:03 2023 -0700
dependabot: bump VachaShah/backport from 1.1.4 to 2.2.0 (#1039)
Bumps [VachaShah/backport](https://github.com/vachashah/backport) from 1.1.4 to 2.2.0.
- [Release notes](https://github.com/vachashah/backport/releases)
- [Changelog](https://github.com/VachaShah/backport/blob/main/CHANGELOG.md)
- [Commits](https://github.com/vachashah/backport/compare/v1.1.4...v2.2.0)
---
updated-dependencies:
- dependency-name: VachaShah/backport
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 726759f104117e1a28648a1524cdface49168b79
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:53 2023 -0700
dependabot: bump actions/checkout from 2 to 4 (#1041)
Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v2...v4)
---
updated-dependencies:
- dependency-name: actions/checkout
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit f6ac01886a662264323d1e11a2199fb190148c80
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:38 2023 -0700
dependabot: bump org.jacoco:org.jacoco.ant from 0.8.5 to 0.8.10 (#1044)
Bumps [org.jacoco:org.jacoco.ant](https://github.com/jacoco/jacoco) from 0.8.5 to 0.8.10.
- [Release notes](https://github.com/jacoco/jacoco/releases)
- [Commits](https://github.com/jacoco/jacoco/compare/v0.8.5...v0.8.10)
---
updated-dependencies:
- dependency-name: org.jacoco:org.jacoco.ant
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit d30bcc394e6f281b6de504f102a0085ae56e78e4
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:22 2023 -0700
dependabot: bump org.junit.jupiter:junit-jupiter-api (#1043)
Bumps [org.junit.jupiter:junit-jupiter-api](https://github.com/junit-team/junit5) from 5.9.2 to 5.10.0.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/compare/r5.9.2...r5.10.0)
---
updated-dependencies:
- dependency-name: org.junit.jupiter:junit-jupiter-api
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 92256db92f9ed78cb1de9925297c9ff5cce6da74
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:04:23 2023 -0400
Add dependabot.yml (#1026)
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 23611f6d8ccdc9a4c41469ec0a4746290f976b4f
Author: Jackie Han <hnyng@amazon.com>
Date: Fri Sep 8 11:19:31 2023 -0700
Add 2.10 release notes (#1031)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit ee1db57058e08c36e4820637973f18016cf45015
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Wed Sep 6 16:55:00 2023 -0700
Updates demo certs for integ tests (#1018)
Signed-off-by: Owais Kazi <owaiskazi19@gmail.com>
commit 338d72eb692c81802a70fe42556cde70c01cad6a
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Sep 6 16:08:01 2023 -0700
refactor job response (#1017)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit db456c2543a6f1ff6b77db10bd19952768d16182
Author: Jackie Han <hnyng@amazon.com>
Date: Tue Sep 5 15:47:50 2023 -0700
upgrading commons-lang3 version to fix conflict issue (#1012)
* force commons-lang3 version to fix conflict issue
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from upstream version properties file
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* upgrading commons-lang3 version to align with core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit db788f4714233121eba4238869b8db89ae0037d4
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Tue Sep 5 13:58:31 2023 -0700
Adds auto release workflow (#1003)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 327c141e9b70465b1760f9ebf8c001a2e439b01f
Author: Jackie Han <hnyng@amazon.com>
Date: Fri Sep 1 13:00:23 2023 -0700
Revert "Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards (#948)" (#999)
This reverts commit bc1649922ef39619424fc16c64af5836e48a4a12.
commit 4a09b741e1c127a92775cb55f4c56aa5c4f3f6a3
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Aug 21 11:21:36 2023 -0700
Update Gradle Wrapper to 8.2.1 for Enhanced JDK20 Compatibility (#985)
- **Reason for Upgrade**: The migration to JDK20 ([reference](https://github.com/opensearch-project/opensearch-build/blob/aa65a8ecd69f77c3d3104043dd1c48dff708bffa/manifests/3.0.0/opensearch-3.0.0.yml#L9)) rendered the current Gradle version (7.6.1) incompatible.
- **Actions Taken**:
- **Gradle Wrapper Update**: Upgraded the Gradle wrapper to version 8.2.1 to maintain compatibility with JDK20. The gradle wrapper files are generated using the `./gradlew wrapper` command.
- Applied `spotless` due to new formatting requirements in Gradle 8.
- Resolved test "jar hell" issues. Gradle 8 introduced internal JARs to the test classpath that conflicted with dependencies from `org.junit.vintage:junit-vintage-engine`. As a remedy, these conflicting JARs have been excluded.
- **Relevant Pull Requests**:
- [Alerting#893](https://github.com/opensearch-project/alerting/pull/893/files)
- [ML-Commons#892](https://github.com/opensearch-project/ml-commons/pull/892)
- [Security PR](https://github.com/opensearch-project/security/pull/2978)
- **Verification**: Successfully verified the changes using `gradle build`.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 5ac6390e7de643d8177f0a5833995032f3a279ad
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Aug 17 11:08:36 2023 -0700
Refactoring task cache manager for forecasting (#982)
* Refactoring Shared Functionality for Broader Task Compatibility
This PR extracts shared components from `ADTaskCacheManager` into `TaskCacheManager` to support the requirements of the forecasting feature.
**Renamings**:
- **Method-level in `ADTaskCacheManager`**:
- `addDeletedDetector` to `addDeletedConfig`
- `addDeletedDetectorTask` to `addDeletedTask`
- `hasDeletedDetectorTask` to `hasDeletedTask`
- `pollDeletedDetector` to `pollDeletedConfig`
- `pollDeletedDetectorTask` to `pollDeletedTask`
- **Variable-level in `AnomalyDetectorSettings`**:
- `CHECKPOINT_MAINTAIN_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_MAINTAIN_QUEUE_MAX_HEAP_PERCENT`
- `CHECKPOINT_READ_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_READ_QUEUE_MAX_HEAP_PERCENT`
- `CHECKPOINT_SAVING_FREQ` to `AD_CHECKPOINT_SAVING_FREQ`
- `CHECKPOINT_TTL` to `AD_CHECKPOINT_TTL`
- `CHECKPOINT_WRITE_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_WRITE_QUEUE_MAX_HEAP_PERCENT`
- `COLD_ENTITY_QUEUE_MAX_HEAP_PERCENT` to `AD_COLD_ENTITY_QUEUE_MAX_HEAP_PERCENT`
- `DEDICATED_CACHE_SIZE` to `AD_DEDICATED_CACHE_SIZE`
- `ENTITY_COLD_START_QUEUE_CONCURRENCY` to `AD_ENTITY_COLD_START_QUEUE_CONCURRENCY`
- `ENTITY_COLD_START_QUEUE_MAX_HEAP_PERCENT` to `AD_ENTITY_COLD_START_QUEUE_MAX_HEAP_PERCENT`
- `EXPECTED_COLD_ENTITY_EXECUTION_TIME_IN_MILLISECS` to `AD_EXPECTED_COLD_ENTITY_EXECUTION_TIME_IN_MILLISECS`
- `FILTER_BY_BACKEND_ROLES` to `AD_FILTER_BY_BACKEND_ROLES`
- `MAX_ENTITIES_PER_QUERY` to `AD_MAX_ENTITIES_PER_QUERY`
- `MAX_MODEL_SIZE_PER_NODE` to `AD_MAX_MODEL_SIZE_PER_NODE`
- `MAX_MULTI_ENTITY_ANOMALY_DETECTORS` to `AD_MAX_HC_ANOMALY_DETECTORS`
- `MAX_RETRY_FOR_END_RUN_EXCEPTION` to `AD_MAX_RETRY_FOR_END_RUN_EXCEPTION`
- `MAX_SINGLE_ENTITY_ANOMALY_DETECTORS` to `AD_MAX_SINGLE_ENTITY_ANOMALY_DETECTORS`
- `MODEL_MAX_SIZE_PERCENTAGE` to `AD_MODEL_MAX_SIZE_PERCENTAGE`
- `PAGE_SIZE` to `AD_PAGE_SIZE`
- `RESULT_WRITE_QUEUE_MAX_HEAP_PERCENT` to `AD_RESULT_WRITE_QUEUE_MAX_HEAP_PERCENT`
- **Class-level**:
- `ADRealtimeTaskCache` renamed to `RealtimeTaskCache`
- **Package-level**:
- Shifted from `org.opensearch.ad.breaker` to `org.opensearch.timeseries.breaker`
**Migrations**:
- Variables transferred from `AnomalyDetectorSettings` to `TimeSeriesSettings`:
- `BATCH_BOUNDING_BOX_CACHE_RATIO`
- `CHECKPOINT_MAINTAIN_REQUEST_SIZE_IN_BYTES`
- `CHECKPOINT_WRITE_QUEUE_SIZE_IN_BYTES`
- `DEFAULT_AD_JOB_LOC_DURATION_SECONDS` (renamed to `DEFAULT_JOB_LOC_DURATION_SECONDS`)
- `ENTITY_REQUEST_SIZE_IN_BYTES`
- `HOURLY_MAINTENANCE`
- `INTERVAL_RATIO_FOR_REQUESTS`
- `LOW_SEGMENT_PRUNE_RATIO`
- `MAINTENANCE_FREQ_CONSTANT`
- `MAX_COLD_START_ROUNDS`
- `MAX_QUEUED_TASKS_RATIO`
- `MAX_TOTAL_RCF_SERIALIZATION_BUFFERS`
- `MAX_CHECKPOINT_BYTES`
- `MEDIUM_SEGMENT_PRUNE_RATIO`
- `NUM_MIN_SAMPLES`
- `NUM_SAMPLES_PER_TREE`
- `NUM_TREES`
- `QUEUE_MAINTENANCE`
- `RESULT_WRITE_QUEUE_SIZE_IN_BYTES`
- `SERIALIZATION_BUFFER_BYTES`
- `THRESHOLD_MIN_PVALUE`
- `TIME_DECAY`
**Deletions**:
- Obsolete settings and methods:
- `DESIRED_MODEL_SIZE_PERCENTAGE` in `AnomalyDetectorSettings`
- `getDesiredModelSize` in `MemoryTracker`
**Modifications**:
- `MemoryTracker` enums renamed for clear differentiation between real-time and historical memory usage, adding `REAL_TIME_FORECASTER` for a harmonized single-stream and HC analysis approach.
**Tests**:
- Changes validated with a successful Gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 0c5b4b94cb5b192160463fa8a5f58eac587fe95d
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Aug 15 13:09:17 2023 -0700
Update RCF to v3.8 and Enable Auto AD with 'Alert Once' Option (#979)
* Update RCF to v3.8 and Enable Auto AD with 'Alert Once' Option
This PR added support for automatic Anomaly Detection (AD) and the 'Alert Once' option introduced in RCF 3.8.
Testing done:
1. Deserialization Test:
* Verified model deserialization from 3.0-rc3.
* Ensured consistent scoring using the rc3 checkpoint and rc3 dependency on identical data.
2. Backward Compatibility Test:
* Executed a mixed cluster with versions 2.10 and 3.0.
* Validated that older detectors still produce results without throwing any exceptions in a blue-green simulation scenario.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* reduce recall since alertOnce reduced recall
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* remove commented out code
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit cadc9bbd949daf4f2669335bfb8629e2137c108d
Author: Joshua Palis <jpalis@amazon.com>
Date: Fri Aug 11 16:02:38 2023 -0700
Fixing imports, adding TermsAggregator BucketCountThresholds for StringTerms, setting AnomalyResult grade to 0 if negative value (#976)
Signed-off-by: Joshua Palis <jpalis@amazon.com>
commit 3985cd2f82f2cfa57604ecf5a512bb042e632cae
Author: Romain Tartière <romain@blogreen.org>
Date: Wed Aug 9 08:59:30 2023 -1000
Fix build with latest OpenSearch (for real this time) (#972)
This is a follow-up to #971, where commit
2839bc2c6f470639b68901086c80cb2152d96558 only fixed _some_ but not _all_
of the build errors (it allowed `./gradlew run` to pass but `./gradlew
build` was failing).
Fix the build errors when we run `./gradlew build`.
Signed-off-by: Romain Tartière <romain@blogreen.org>
commit 2839bc2c6f470639b68901086c80cb2152d96558
Author: Romain Tartière <romain@blogreen.org>
Date: Tue Aug 8 13:15:04 2023 -1000
Fix build with latest OpenSearch (#971)
OpenSearch recently merged some code that cause buid failure for this
module, as spotted in #585.
This change the import to match the new one after
https://github.com/opensearch-project/OpenSearch/pull/9103
Signed-off-by: Romain Tartière <romain@blogreen.org>
commit d4946f04e7ad44f0bc79215962c6678786c592ff
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Aug 7 14:21:56 2023 -0700
Refactor ADTask and Related Components (#969)
* Refactor ADTask and Related Components
This PR includes several key refactoring changes:
- Extracts common code from ADTask into TimeSeriesTask, creating ForecastTask for forecasting-specific logic.
- Consolidates common code from ADTaskType into TaskType and introduces ForecastTaskType for forecasting-related purposes.
- Renames ADTaskState to TaskState for consistent code reuse.
- Renames the method getId in ADTask to getConfigId to differentiate it from other IDs like task id.
Testing done:
1. Added unit tests for the new code to ensure functionality.
2. Executed a successful Gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* add comments and address compiler errors
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Amit's comments and address compiler failure
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 1130a1ba6fc3c08f375dd99f98e93e4ee36331fb
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jul 27 10:39:39 2023 -0700
Refactoring NodeStateManager etc. to support forecasting functionality (#965)
* Refactoring NodeStateManager etc. to support forecasting functionality
This commit extends the codebase to support both Anomaly Detection (AD) and forecasting. It contains a mixture of refactoring, renaming, removal of unused code, and package moving tasks. Here are the details:
Refactoring:
- `NodeStateManager.getAnomalyDetector` is now `getConfig`, with added functionality to fetch a Forecaster. The method comments are updated for clarity.
- Existing methods (`getFeatureSamplesForPeriods`, `getColdStartSamplesForPeriods`, `createPreviewSearchRequest`, `getMinDataTime`) have been added in `SearchFeatureDao` to handle forecasting logic.
- Adjusted `SecurityClientUtil` and `ParseUtils` to handle forecasting logic.
- Cleaned up `NodeState` to differentiate state for AD and forecasting.
Renaming:
- `AnomalyDetectorJob` is renamed to `Job` to facilitate reuse for forecasting.
- `NodeStateManager.getAnomalyDetectorJob` is renamed to `getJob`.
- Certain settings in `AnomalyDetectorSettings` are renamed to reflect they are meant for the AD setting. They have been marked as deprecated and new settings are used in `TimeSeriesSettings` instead.
- `IndexAnomalyDetectorJobActionHandler.getAnomalyDetectorJobForWrite` is renamed to `getJobForWrite`.
- `ADSafeSecurityInjector` is renamed to `TimeSeriesSafeSecurityInjector`.
Removing unused code:
- Synchronous code in `ClientUtil`, `IndexUtils`, and `CheckpointDao` is removed.
- The unused class `Throttler` is deleted.
- Mapping file names are changed, and the code referencing these files is adjusted.
Package moving:
- Several classes (`ClientUtil`, `MultiResponsesDelegateActionListener`, `SafeSecurityInjector`, `SecurityUtil`, `ExceptionUtil`, `SearchFeatureDao`, `CleanState`, `ExpiringState`, `MaintenanceState`, `NodeState`, `SingleStreamModelIdMapper`, `BackPressureRouting`) are moved to the respective `org.opensearch.timeseries` packages.
Miscellaneous:
- Fixed compiler failures caused by changes in https://github.com/opensearch-project/OpenSearch/pull/8730 by replacing `DoubleArrayList` with `java.util.ArrayList`.
- Updates the Backwards Compatibility (bwc) version to align with the core's incremented bwc version as per [OpenSearch PR #8670](https://github.com/opensearch-project/OpenSearch/pull/8670). This change prevents the issue described in [OpenSearch Issue #5076](https://github.com/opensearch-project/OpenSearch/issues/5076).
Testing:
- Executed a `gradle build`.
- Added new tests for `ClientUtil` and `NodeStateManager`.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comment
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* fix compiler error and comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit f0ed43b1aa3c5d80dc6f23a5dd4465bb03ef1739
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jul 17 15:18:03 2023 -0700
Rename AD to time series analytics & Resolve Compiler Errors (#951)
This commit focuses on renaming the AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin as well as addressing compiler errors due to package import changes. The primary transformations are:
* Renamed AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin.
* Updated all references from AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin.
* Amended plugin information in build.gradle and src/main/resources/es-plugin.properties.
* Switched job type in TimeSeriesAnalyticsPlugin from opendistro_anomaly_detector to opensearch_time_series_analytics.
These changes led to the modification of our plugin binary from opensearch-anomaly-detection-3.0.0.0-SNAPSHOT.jar to opensearch-time-series-analytics-3.0.0.0-SNAPSHOT.jar.
Moreover, following changes from OpenSearch Pull Request #8157, compiler errors were encountered, which were resolved by updating the import packages
* org.opensearch.common.io.stream.NamedWriteableRegistry => org.opensearch.core.common.io.stream.NamedWriteableRegistry
* org.opensearch.common.xcontent.XContentParserUtils => * org.opensearch.core.xcontent.XContentParserUtils
* org.opensearch.common.bytes.BytesArray => org.opensearch.core.common.bytes.BytesArray * org.opensearch.common.io.stream.StreamInput => * org.opensearch.core.common.io.stream.StreamInput ** org.opensearch.common.io.stream.StreamOutput => org.opensearch.core.common.io.stream.StreamOutput
* org.opensearch.common.io.stream.Writeable => org.opensearch.core.common.io.stream.Writeable
* org.opensearch.common.io.stream.NotSerializableExceptionWrapper => org.opensearch.core.common.io.stream.NotSerializableExceptionWrapper
* org.opensearch.rest.RestStatus => org.opensearch.core.rest.RestStatus
* org.opensearch.common.ParsingException => org.opensearch.core.common.ParsingException
* org.opensearch.common.bytes.BytesReference => org.opensearch.core.common.bytes.BytesReference
* org.opensearch.common.io.stream.InputStreamStreamInput => org.opensearch.core.common.io.stream.InputStreamStreamInput
* org.opensearch.common.io.stream.OutputStreamStreamOutput => org.opensearch.core.common.io.stream.OutputStreamStreamOutput
* org.opensearch.index.shard.ShardId => org.opensearch.core.index.shard.ShardId* org.opensearch.index.Index => org.opensearch.core.index.Index
* org.opensearch.core.index.IndexNotFoundException => org.opensearch.index.IndexNotFoundException
Validation steps were executed to ensure these changes did not break functionality:
* gradle build was successful. A local build was required due to outdated OpenSearch and job scheduler nightly builds.
* Backward compatibility tests were performed on a two-node 2.9 cluster running some detectors. These detectors continued to produce results on a 3.0 cluster with these updates.
* I can start new detectors on the 3.0 node.
* After shutting down a 2.9 node, the job transfer to the 3.0 node was successful and the job continued to perform as expected.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit c7c6a46e88e15f615fc9dae0499cf0d674662057
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Thu Jul 13 15:42:46 2023 -0700
Add 2.9 release notes (#952)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit bc1649922ef39619424fc16c64af5836e48a4a12
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Jul 11 13:34:09 2023 -0700
Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards (#948)
* Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards
In this PR, we temporarily enforce DOCUMENT replication for AD indices. This change is necessary due to the current limitation of SegRep, which doesn't support Get/MultiGet by ID. This measure will be in place until SegRep adds support for these operations.
This adjustment aligns with the modification made in the referenced PR: job-scheduler PR #417
Additionally, this PR increases the number of primary shards for forecasting indices from 10 to 20, recognizing the higher write intensity of these indices. For instance, when the horizon is 24, we are expected to save 25 documents: 24 for each forecast and 1 for the actual value. In contrast, for AD, we save one document per actual value.
Testing done:
1. gradle build passed
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Fix comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit a1203827617ee42b35d41cb8b010719f334f73b7
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jul 10 10:53:17 2023 -0700
Add ForecastResult and Refactor Shared Code (#941)
This commit adds the functionality of ForecastResult, while also performing several necessary refactorings.
Firstly, we introduce ForecastResult, which closely mirrors the functionality of AnomalyResult. Any shared code between these two classes has been abstracted out into a new parent class, IndexableResult. This refactoring was undertaken to facilitate code reuse and improve maintainability, as both classes deal with storing fields that need to be saved in result indices.
Secondly, we've also extracted common code from ThresholdingResult into another new class, IntermediateResult. This work is in preparation for a forthcoming PR which will introduce RCFCasterResult. In this change, we moved the 'toAnomalyResult' method to IndexableResult, and renamed it to 'toIndexableResults'. This renaming allows for reuse in the upcoming RCFCasterResult. The updated method now returns a list of results instead of a single result. The shift caters for the RCFCasterResult use case where one RCFCasterResult is stored across multiple ForecastResult documents.
Furthermore, this commit modifies the 'entity' field in several methods to be of the Optional type, indicating that it can be empty. This change provides a clear signal to other developers about the optional nature of these fields.
In addition, this commit updates the mapping for the forecast result index. The prior mapping was a placeholder and this change brings it up to date.
We've also moved to using httpcore5 and httpclient5 versions from OpenSearch core, as necessitated by recent changes in [OpenSearch PR #8434](https://github.com/opensearch-project/OpenSearch/pull/8434/files). This shift resolves potential jar hell issues with httpcore5 and httpclient5.
Lastly, we've made name and package changes:
1. Renamed 'initDetectionStateIndex' in ADIndexManagement to 'initStateIndex' to align with ForecastIndexManagement naming.
2. Moved the 'DataByFeatureId' class to the 'timeseries' package for better organization.
This commit also completes the 'createDummyIndexRequest' method in ForecastIndexManagement by invoking 'ForecastResult.getDummyResult()', which is now possible due to the introduction of the ForecastResult implementation.
Testing done:
1. added tests for new code
2. gralde build passes
3. e2e tests
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit f24d9e32ff739abf29cac3da15fd00f74219e213
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Thu Jul 6 17:28:09 2023 -0700
Bump scipy from 1.8.0 to 1.10.0 in /dataGeneration (#943)
Bumps [scipy](https://github.com/scipy/scipy) from 1.8.0 to 1.10.0.
- [Release notes](https://github.com/scipy/scipy/releases)
- [Commits](https://github.com/scipy/scipy/compare/v1.8.0...v1.10.0)
---
updated-dependencies:
- dependency-name: scipy
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 9b9fd2ba3f3e678d717c0a45af8069bb67828808
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Jun 27 16:08:55 2023 -0700
bump guava version to 32.0.1 (#933)
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit 99749dfa6bfc8a2f2c4660ca01d75d1ad57124a5
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jun 26 16:46:24 2023 -0700
Refactoring Index Creation for Improved Code Reuse and Consistency (#932)
This Pull Request significantly refactors the index creation module to promote greater code reusability and consistency. The primary changes are outlined as follows:
1. Code Migration: Common code segments have been moved from AnomalyDetectionIndices to IndexManagement. In addition, component-specific code has been established in ADIndexManagement and ForecastIndexManagement. The bulk of changes are concentrated in these three classes, with the remainder of the modifications relating to reference/test changes.
2. Function Renaming: Several functions have been renamed for broader applicability and consistency:
* AnomalyDetectorFunction has been renamed to ExecutorFunction for potential use in Forecasting.
* AnomalyDetectorSettings.MAX_PRIMARY_SHARDS has been renamed to AnomalyDetectorSettings.AD_MAX_PRIMARY_SHARDS in light of the new ForecastSettings.FORECAST_MAX_PRIMARY_SHARDS.
* doesAnomalyDetectorJobIndexExist() has been renamed to doesJobIndexExist() to allow for job index reusability across Anomaly Detection (AD) and forecasting. Analogous changes have been made to other job index-related functions.
* doesAnomalyDetectorIndexExist() has been renamed to doesConfigIndexExist() to allow for config index reusability across AD and forecasting. Analogous changes have been made to other config index-related functions.
* detectionIndices.doesDetectorStateIndexExist() has been renamed to detectionIndices.doesStateIndexExist(), as the former name was unnecessarily redundant. Similar modifications have been made to the result and checkpoint index.
3. Class Migration: The classes ThrowingSupplierWrapper, ThrowingConsumer, and ThrowingSupplier have been moved from org.opensearch.ad.util to org.opensearch.timeseries.function to promote code reuse.
4. Initial Forecast Indices' Mapping: An initial version of forecast indices' mapping has been added, which can be adjusted as required in the future.
5. In terms of version updates, 2.x has been bumped to 2.9, prompting an increment of the Backward Compatibility (BWC) test version to 2.9.
6. Update dependency com.google.guava:guava to v32 for cve fix.
Testing done:
Testing has been performed with new tests added for forecast index creation, and the grade build passes successfully.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit aedb781a6b1df984636d72d50b65d41138539918
Author: Craig Perkins <craig5008@gmail.com>
Date: Tue Jun 20 16:55:19 2023 -0400
Fix main build - update import of Releasable and remove reference to BaseExceptionsHelper (#930)
* Fix main build - update import of Releasable and remove reference to BaseExceptionsHelper
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update imports in test classes
Signed-off-by: Craig Perkins <cwperx@amazon.com>
---------
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit fce78c29c0375ae06f56e16c85fb98933401e28f
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Jun 14 10:36:40 2023 -0700
Refactor: Reorganize code for Forecasting and AnomalyDetector packages (#925)
* Refactor: Reorganize code for Forecasting and AnomalyDetector packages
This PR includes several refactorings to increase code reuse and improve readability:
1. Entity, FeatureData, and RestHandlerUtils have been moved from the 'ad' package to the 'timeseries' package, enabling their use within the Forecasting code.
2. A new class, DataByFeatureId, has been created to hold shared code previously located in FeatureData. FeatureData now inherits from DataByFeatureId. The standalone usage of DataByFeatureId will be detailed in subsequent PRs.
3. Renamed checkAnomalyDetectorFeaturesSyntax to checkFeaturesSyntax in RestHandlerUtils to make it more generic and usable for Forecasting.
4. Constants AGG_NAME_MAX_TIME, AGG_NAME_MIN_TIME, DATE_HISTOGRAM, and FEATURE_AGGS have been moved from ADCommonName to CommonName to make them accessible for Forecasting.
5. A new method, parseConfig, has been added to the Config class. This method can parse configuration for either AnomalyDetector or Forecaster based on input.
Testing:
The changes have been validated with a successful gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Amit and Owais's comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 02c120f025f73f3d45a8477c7ef8b4873befebfa
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jun 12 11:54:39 2023 -0700
Updated Maintainers and CODE_OWNERS list (#926)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 2ea4dcf430b40a710a0babb04881eeff9fb2d689
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jun 8 15:11:44 2023 -0700
Add Forecaster class (#920)
* Add Forecaster class
This PR adds class Forecaster that serves as the configuration POJO for forecasting. Shared code between AnomalyDetector and Forecaster is extracted and moved to the Config class to reduce duplication and promote reusability. References to the common code in related classes have also been adjusted.
Testing done:
1. gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* fix compiler error due to a recent core change
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Sudipto and Amit's comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit ee04225349a5f0f003d56e77a3243386f4a9673d
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri Jun 2 15:42:19 2023 -0700
Refactor: Migrate files from 'ad' to 'timeseries' package (#918)
* Refactor: Migrate files from 'ad' to 'timeseries' package
This commit involves moving various files from the 'ad' package to the 'timeseries' package. All changes to dependent imports were handled automatically through the IDE, and no changes to file contents were made in the process.
Testing done:
- gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* move ParseUtils to util package
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 472868d165c2234eece8827584f64086aaf7ae92
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jun 1 11:17:16 2023 -0700
Refactor Shared Settings, Introduce Dynamic Forecast Settings, Rename (#912)
* Refactor Shared Settings, Introduce Dynamic Forecast Settings, and Rename Checkpoint mapping File
This commit has undertaken three changes:
* Refactoring of Shared Settings: I've performed a refactoring to unify the settings that are shared between the AD and forecasting modules.
* Introduction of Dynamic Forecast Settings: To increase the adaptability of our system, I've implemented dynamic forecast settings. These settings mirror the existing structure of the AD dynamic settings and will enable us to adjust forecast settings on-the-fly.
* Renaming of Checkpoint File: To enhance the consistency across our AD mapping files, I've renamed checkpoint.json to anomaly-checkpoint.java.
Testing done:
1. added tests for new settings.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* name change and delete files
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 04ab91e60e9d71765a7b9df10b86e0e53ba4d715
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 31 12:18:54 2023 -0700
add 2.8 release notes (#915)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 98da8dffe8d336793ae35658015650b0f83aeef1
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 24 14:37:38 2023 -0700
Implementing Multiple Imputation Methods for Missing Values (#907)
* Implementing Multiple Imputation Methods for Missing Values
This Pull Request introduces multiple imputation methods to handle missing data in Anomaly Detection (AD) and forecasting. The ability to handle missing data is crucial to improve the robustness and accuracy of our models.
The following imputation methods have been implemented:
* Zero Imputation (ZERO): This method replaces all missing values with 0's. It's a simple approach, but it may introduce bias if the data is not centered around zero.
* Fixed Values Imputation (FIXED_VALUES): This method replaces missing values with a predefined set of values. The values are the same for each input dimension, and they need to be specified by the user.
* Previous Value Imputation (PREVIOUS): This method replaces missing values with the last known value in the respective input dimension. It's a commonly used method for time series data, where temporal continuity is expected.
* Linear Interpolation (LINEAR): This method estimates missing values by interpolating linearly between known values in the respective input dimension. This method assumes that the data follows a linear trend.
These methods are designed to provide a set of options for users to handle missing data based on their specific needs and the nature of their data.
Testing Done:
The code changes in this pull request have been validated through a gradle build to ensure that all new and existing tests pass successfully.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Various changes
The commit makes all new files use the shortened header text and addresses compiler/test issues due to core refactoring
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit da608aaa3d3f955efe32b0cb33b3c8cfdd7a7718
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue May 16 11:37:34 2023 -0700
Code Refactoring for CommonMessages (#902)
* Code Refactoring for CommonMessages
In this pull request, I have refactored the code related to shared log or error messages in both AD and forecasting modules to CommonMessages. Additionally, the previously used CommonErrorMessages has been renamed to ADCommonMessages. For the Forecasting module, I have introduced new names in ForecastCommonMessages.
Testing done:
* gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Update string constants wording
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve wording and remove redundant variables
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 041d6ce73d37f1697013b2d2f0683fbfe012247c
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri May 12 13:05:56 2023 -0700
Code Refactoring for CommonName (#901)
In this pull request, I have refactored the code related to shared names in both AD and forecasting modules to CommonNames. Additionally, the previously used CommonName has been renamed to ADCommonName. For the Forecasting module, I have introduced new names in ForecastCommonNames.
Testing done:
* gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit e2fee9d6ba59cc2a23eadbb50a80414fcc7dbf8f
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 10 17:26:31 2023 -0700
Update outdated MAINTAINERS and OWNERS list (#898)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 98b566d1ec57ffd8970b5180c54b493deb1a24ac
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Wed May 10 18:03:04 2023 -0400
Sync up CODEOWNERS with MAINTAINERS.md. (#897)
Signed-off-by: dblock <dblock@amazon.com>
commit 1f8415aa39fa4ec3ba016214255aa0e79b7c7d63
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue May 9 12:55:35 2023 -0700
Various fixes (#886)
* Various fixes
This pull request addresses several issues related to the compiler and tests in the current main branch.
The first major change involves replacing ImmutableOpenMap with java.util.Map in the core. This modification is implemented in the following pull requests:
https://github.com/opensearch-project/OpenSearch/pull/7165
https://github.com/opensearch-project/OpenSearch/pull/7301
To accommodate this change, the codebase of the AD (Anomaly Detection) module has been refactored to utilize JDK maps. As a consequence of this change, passing null to the custom parameters of ClusterState is no longer permissible, as it leads to a NullPointerException. The error stack trace is as follows:
java.lang.NullPointerException: Cannot invoke "Object.getClass()" because "m" is null
at __randomizedtesting.SeedInfo.seed([60CDDB34427ACD0C:6E72DB4ED18E018D]:0)
at java.base/java.util.Collections.unmodifiableMap(Collections.java:1476)
at org.opensearch.cluster.ClusterState.<init>(ClusterState.java:219)
at org.opensearch.ad.transport.DeleteAnomalyDetectorTests.createClusterState(DeleteAnomalyDetectorTests.java:216)
at org.opensearch.ad.transport.DeleteAnomalyDetectorTests.testDeleteADTransportAction_LatestDetectorLevelTask(DeleteAnomalyDetectorTests.java:160)
To address this issue, we have replaced the usage of null with new HashMap<>().
The second change in this pull request aligns with the modifications introduced in PR https://github.com/opensearch-project/anomaly-detection/pull/878.
The third issue is related to the incompatibility between tests that utilize the @Parameters annotation and those that do not, as explained in https://tinyurl.com/2y265s2w. Specifically, the SearchFeatureDaoTests class runes tests with the @Parameters annotation, whereas SearchFeatureDao tests do not.
Testing done:
1. gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 0a48da9e1a0cd70c64cc2da228674baaf377c89e
Author: Jackie Han <hnyng@amazon.com>
Date: Mon Apr 17 12:44:06 2023 -0700
Add 2.7 release notes (#871)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 1edc2ef1ccfe20938711984744b20d1f2ec96a3c
Author: Jackie Han <hnyng@amazon.com>
Date: Tue Apr 11 17:53:57 2023 -0700
Update OpenSearchRejectedExecutionException import (#861)
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update NodeInfo constructor and javadoc for isAdmin method
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit b8df172c2364997c446096e960068d6fc5d2e6f6
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Apr 11 10:55:28 2023 -0700
Giving admin priority over backendrole filtering (#850)
* giving admin priority over backend role filtering
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
* fix security tests
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
* remove redundent line in test case
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
---------
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit fd2fd5d5f63c9004b9f265e3c1e4475282447da8
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Thu Mar 16 14:30:32 2023 -0400
Created untriaged issue workflow. (#809)
Signed-off-by: dblock <dblock@amazon.com>
commit fd547014fdde5114bbc9c8e49fe7aaa37eb6e793
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Mar 1 16:41:05 2023 -0800
Publish snapshots to maven via GHA, fix spotless errors, and bump bwc version (#827)
We are de-coupling the task of publishing the maven snapshots from centralized build workflow to individual repositories. This PR publishes maven snapshots using GitHub Actions.
Testing done:
1. ran ./gradlew publishPluginZipPublicationToSnapshotsRepository according to https://github.com/opensearch-project/anomaly-detection/issues/813
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit b6be5960fb8cff41f0e9d13d5f5a971c289b80ed
Author: Jackie Han <hnyng@amazon.com>
Date: Thu Feb 23 12:23:01 2023 -0800
Update xcontent imports (#822)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 1dcb78a6c4d1331133aefe5af7adf137daa8846f
Author: Jackie Han <hnyng@amazon.com>
Date: Wed Feb 22 11:17:21 2023 -0800
Add 2.6 release note (#818)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 553688aae45590c37cc4d86102642d0b3a6ebb33
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Feb 9 13:38:14 2023 -0800
Revert changes to exception message (#803)
* Revert changes to exception message
We used to log "No RCF models are available either because RCF models are not ready..." and now we log "resource_not_found_exception: No checkpoints found for model id...". This change caused an integration test failure. This PR reverts it back.
Testing done:
1. verified that the original log is back.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* check NO_MODEL_ERR_MSG instead of NO_CHECKPOINT_ERR_MSG
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit c9bdc628a03c4ced3cd1ebeec44ebff792d7ff98
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri Feb 3 11:15:37 2023 -0800
fixing dls/fls logic around numeric aggregations (#801)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 9cebc5bc97a84dd78ac8892863ff7d674428bced
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Jan 10 02:17:04 2023 +0000
adding 2.5 release notes
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit 2ace84643fd199a5e5179e6d21ab76ae212cb7d8
Author: Ryan Bogan <10944539+ryanbogan@users.noreply.github.com>
Date: Tue Jan 10 13:31:49 2023 -0800
Add jackson back to build.gradle (#780)
Signed-off-by: Ryan Bogan <rbogan@amazon.com>
commit a5d60eefab5ac30ef5243da8e7a88b7a2189cd5c
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jan 9 15:49:35 2023 -0800
bump bwc to 2.6.0 (#775)
We need to bump the version because only the latest 2.x will be upgradable to 3.0 when that ship. Since OpenSearch core bumped to 2.6, we need to do that as well. Note after bumping version, bwc still fails to find 2.6.0 core zip.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 27ed49863bfbef90551cdfacc6b51703bf622e25
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jan 9 12:17:57 2023 -0800
Fix the discrepancy between Profile API and real time tasks API (#770)
* Fix the discrepancy between Profile API and real time tasks API
This PR fixes the discrepancy by querying the result index when the total updates is less than 32. We have done similar things in profile API so I refactored reusable code to ProfileUtil. We also cached whether we have queried the result index and won't repeatedly issue the extra query.
Testing done:
1. repeated repro steps in https://github.com/opensearch-project/anomaly-detection/issues/502 and verified the issue has been resolved.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit b49a36b3e7962a205695d451e0497ee4f57fb2cb
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Thu Jan 5 10:19:51 2023 -0800
Updated MAINTAINERS.md to match recommended opensearch-project format. (#771)
Signed-off-by: dblock <dblock@amazon.com>
commit 20d2c5f94811f62a7077142ba505bed272a83549
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Dec 20 13:16:21 2022 -0800
update bwc to 2.5 (#765)
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit e08314f43a22d2692e8467efae3699fce0440611
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Dec 20 11:00:45 2022 -0800
[Forward-Port to main] Fix _source bug (#749) (#764)
* Fix _source bug (#749)
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
* fixed strings method
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit 134942ed61b984e57b1f9c6bc7d416232d8f59d2
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri Dec 16 09:38:46 2022 -0800
Speed up cold start (#753)
* Speed up cold start
If historical data is enough, a single stream detector takes 1 interval for cold start to be triggered + 1 interval for the state document to be updated. Similar to single stream detectors, HCAD cold start needs 2 intervals and one more interval to make sure an entity appears more than once. So HCAD needs three intervals to complete cold starts. Long initialization is the single most complained problem of AD. This PR reduces both single stream and HCAD detectors' initialization time to 1 minute by
* delaying real time cache update by one minute when we receive ResourceNotFoundException in single stream detectors or when the init progress of HCAD real time cache is 0. Thus, we can finish the cold start and writing checkpoint one minute later and update the state document accordingly. This optimization saves one interval to wait for the state document update.
* disable the door keeper by default so that we won't have to wait an extra interval in HCAD.
* trigger cold start when starting a real time detector. This optimization saves one interval to wait for the cold start to be triggered.
Testing done:
* verified the cold start time is reduced to 1 minute.
* added tests for new code.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 609abe42df8af450e48bfa122746361f7a8201c7
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Thu Dec 15 17:11:10 2022 -0500
Fix: typo in ohltyler. (#760)
Signed-off-by: dblock <dblock@amazon.com>
commit ce3d747317aec5ccef080c767d4ba8e7015c5a2a
Author: Varun Jain <varunudr@amazon.com>
Date: Tue Dec 6 15:44:33 2022 -0800
Model Profile Test (#748)
commit 09b4cc1ac3ab9fb4e589754acba619d265603580
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Mon Dec 5 12:06:16 2022 -0800
Use sonatype to fetch JS instead of ci.opensearch.org (#740)
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit a3e2b994ed347263a8dbaf5beed6bd5ddd6931a4
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Nov 30…
kaituo
added a commit
to kaituo/anomaly-detection-1
that referenced
this pull request
Mar 27, 2024
commit 30347847cb4ec87f7318587d97054d91c341a312
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Mar 26 13:40:53 2024 -0700
Upgrade rcf to 4.0 (#1173)
This PR upgrades rcf to 4.0 as it has bug fixes and support for streaming imputation mode.
Testing done:
1. gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 8ca1d0d837dd28b6e0820756136eafb8c3ce03ad
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Mar 25 13:44:45 2024 -0700
dependabot: bump actions/checkout from 3 to 4 (#1098)
Bumps [actions/checkout](https://github.com/actions/checkout) from 3 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v3...v4)
---
updated-dependencies:
- dependency-name: actions/checkout
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit d0a2a8ff9fd9640000763c433e05577eea292c48
Author: Darshit Chanpura <35282393+DarshitChanpura@users.noreply.github.com>
Date: Mon Mar 25 16:44:36 2024 -0400
Updates sample cert and admin keystore (#1163)
Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
commit 1921e12b30ac442cd731a5d7a3bdfd3bc31be82b
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Mar 25 13:14:52 2024 -0700
Bump urllib3 from 1.26.17 to 1.26.18 in /dataGeneration (#1090)
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.17 to 1.26.18.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.17...1.26.18)
---
updated-dependencies:
- dependency-name: urllib3
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 8521a76533b533d6887321505c7b5e3d473b02ae
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Mar 25 13:14:18 2024 -0700
dependabot: bump org.apache.commons:commons-pool2 from 2.11.1 to 2.12.0 (#1088)
Bumps org.apache.commons:commons-pool2 from 2.11.1 to 2.12.0.
---
updated-dependencies:
- dependency-name: org.apache.commons:commons-pool2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 303ceb5b320f148dcd015ab6a11f870ae3e23125
Author: Joshua Palis <jpalis@amazon.com>
Date: Mon Mar 18 16:49:59 2024 -0700
Adding 2.13 release notes (#1170)
Signed-off-by: Joshua Palis <jpalis@amazon.com>
commit 1507dd4b4045bd8e8cdf505d07041ce304788ca0
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Feb 21 15:59:34 2024 -0800
Inject NamedWriteableRegistry in AD node client (#1164)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 5b85720d442d1b43001dde0c20248fd4a20a64b0
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Tue Feb 13 10:20:20 2024 -0800
Fixed lucene url (#1158)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 290bdcd832a0cae6d039787d9f0af73ea6be2ec2
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Feb 6 16:14:49 2024 -0800
add 2.12 release notes (#1152)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 6a6eec347379c997f0f7acc88b027bc1ffdd8f54
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Tue Jan 30 18:20:36 2024 -0800
Add ser/deser to get AD transport action request (#1150)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 475f0c36e5b6267aaeb101627b9c3ae1fcca3a88
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Thu Jan 25 14:37:12 2024 -0800
Updated lucene snapshot url (#1146)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 7192d848d2923566a409901909f342a63695e1c2
Author: Jackie Han <hnyng@amazon.com>
Date: Thu Jan 25 09:48:37 2024 -0800
Remove default admin credentials (#1134)
* Remove default admin credentials
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Replace default password with a placeholder in README files
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 97482c19b0eded34a7f435e589303a834c258aa3
Author: Jackie Han <hnyng@amazon.com>
Date: Wed Jan 24 09:39:55 2024 -0800
Require JDK version for java spotless check (#1129)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 708e0462189677a217b35905c2feba5486c77cdc
Author: Andriy Redko <andriy.redko@aiven.io>
Date: Tue Jan 23 15:11:39 2024 -0500
Update to Jackson 2.16.1 (#1135)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
commit 7c0ce4cb554a05230ecf5365b903219f357997bf
Author: Andriy Redko <drreta@gmail.com>
Date: Tue Jan 16 17:51:37 2024 -0500
Update to Gradle 8.5 (#1131)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
commit e5cbe93c0e9cadebe2a30cba83f99ae8a3f8fe57
Author: zane-neo <zaniu@amazon.com>
Date: Thu Jan 4 16:50:47 2024 +0800
add publishToMavenLocal task to fix zip plugin not pulished to maven local issue when running this script (#1121)
Signed-off-by: zane-neo <zaniu@amazon.com>
commit 106dc25b3ef36beae329dc7882bcdf9c23347fb5
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Dec 27 16:33:25 2023 -0800
Refactor client's getDetectorProfile to use GetAnomalyDetectorTransportAction (#1124)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 59b4ebecfa11cac977f49c999ce85637fb6fac58
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Dec 27 11:56:00 2023 -0800
Add profile transport action to AD client (#1119)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 29711f96dbb2c9abc1181b933a8b334eed63ca66
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Tue Dec 12 08:32:53 2023 -0800
Add an AD transport client (#1110)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 353dcaeb05f8b75fa74d92e2ae8415ab018bc68e
Author: Daniel Widdis <widdis@gmail.com>
Date: Wed Nov 22 13:59:53 2023 -0800
Fix build, update CVE-affected versions (#1102)
* Fix build, update CVE-affected versions
Signed-off-by: Daniel Widdis <widdis@gmail.com>
* Spotless depends on CVE-impacted eclipse dependency, now needs JDK17+
Signed-off-by: Daniel Widdis <widdis@gmail.com>
---------
Signed-off-by: Daniel Widdis <widdis@gmail.com>
commit 4c6ba48bf9fb9234ad8bc0b9193f3c68409acfb9
Author: Peter Zhu <zhujiaxi@amazon.com>
Date: Mon Oct 30 19:35:01 2023 -0400
Fix the bwc test version retrieval (#1093)
* Onboarding jenkins prod docker images to github actions
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
---------
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
commit a1da3aa0eefc6671446d2eb3bc670bad6449d2f0
Author: Peter Zhu <zhujiaxi@amazon.com>
Date: Mon Oct 30 19:14:31 2023 -0400
Onboarding jenkins prod docker images to github actions (#1092)
* Onboarding jenkins prod docker images to github actions
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
---------
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
commit 040cd7e33f8e696ffe7748140c9b0ecc7475d513
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:43:02 2023 -0700
dependabot: bump net.bytebuddy:byte-buddy from 1.14.6 to 1.14.9 (#1081)
Bumps [net.bytebuddy:byte-buddy](https://github.com/raphw/byte-buddy) from 1.14.6 to 1.14.9.
- [Release notes](https://github.com/raphw/byte-buddy/releases)
- [Changelog](https://github.com/raphw/byte-buddy/blob/master/release-notes.md)
- [Commits](https://github.com/raphw/byte-buddy/compare/byte-buddy-1.14.6...byte-buddy-1.14.9)
---
updated-dependencies:
- dependency-name: net.bytebuddy:byte-buddy
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit dd9c1521bc1946027245d65e39a7844cdf04a8b7
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:42:15 2023 -0700
dependabot: bump aws-actions/configure-aws-credentials (#1076)
Bumps [aws-actions/configure-aws-credentials](https://github.com/aws-actions/configure-aws-credentials) from 1.7.0 to 4.0.1.
- [Release notes](https://github.com/aws-actions/configure-aws-credentials/releases)
- [Changelog](https://github.com/aws-actions/configure-aws-credentials/blob/main/CHANGELOG.md)
- [Commits](https://github.com/aws-actions/configure-aws-credentials/compare/v1.7.0...v4.0.1)
---
updated-dependencies:
- dependency-name: aws-actions/configure-aws-credentials
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit d6e3fd7a69b1daea45d7a455335e55b6de118033
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:05:00 2023 -0700
dependabot: bump com.netflix.nebula.ospackage from 11.0.0 to 11.5.0 (#1066)
Bumps com.netflix.nebula.ospackage from 11.0.0 to 11.5.0.
---
updated-dependencies:
- dependency-name: com.netflix.nebula.ospackage
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 57eacf611ce44559e14aa37f2e51dfbb82d53cc2
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:04:19 2023 -0700
dependabot: bump org.apiguardian:apiguardian-api from 1.1.0 to 1.1.2 (#1058)
Bumps [org.apiguardian:apiguardian-api](https://github.com/apiguardian-team/apiguardian) from 1.1.0 to 1.1.2.
- [Release notes](https://github.com/apiguardian-team/apiguardian/releases)
- [Commits](https://github.com/apiguardian-team/apiguardian/compare/r1.1.0...r1.1.2)
---
updated-dependencies:
- dependency-name: org.apiguardian:apiguardian-api
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 6b9faf2b71e5481be366b12bd6f16440c6c8ef89
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:04:01 2023 -0700
dependabot: bump org.junit.platform:junit-platform-launcher (#1056)
Bumps [org.junit.platform:junit-platform-launcher](https://github.com/junit-team/junit5) from 1.9.2 to 1.10.0.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/commits)
---
updated-dependencies:
- dependency-name: org.junit.platform:junit-platform-launcher
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 2a957f2086688b5ee76703406105797d31207cc5
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:03:11 2023 -0700
Bump urllib3 from 1.26.9 to 1.26.17 in /dataGeneration (#1068)
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.9 to 1.26.17.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.9...1.26.17)
---
updated-dependencies:
- dependency-name: urllib3
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit a12e33214f9c138946975801cefa2bd39c7978a9
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 11:29:37 2023 -0700
dependabot: bump org.objenesis:objenesis from 3.0.1 to 3.3 (#1040)
Bumps [org.objenesis:objenesis](https://github.com/easymock/objenesis) from 3.0.1 to 3.3.
- [Release notes](https://github.com/easymock/objenesis/releases)
- [Commits](https://github.com/easymock/objenesis/compare/3.0.1...3.3)
---
updated-dependencies:
- dependency-name: org.objenesis:objenesis
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 5a4ba14a431fbc53f757416542cda25ef2fae58c
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 11:28:46 2023 -0700
dependabot: bump tibdex/github-app-token from 2.0.0 to 2.1.0 (#1065)
Bumps [tibdex/github-app-token](https://github.com/tibdex/github-app-token) from 2.0.0 to 2.1.0.
- [Release notes](https://github.com/tibdex/github-app-token/releases)
- [Commits](https://github.com/tibdex/github-app-token/compare/v2.0.0...v2.1.0)
---
updated-dependencies:
- dependency-name: tibdex/github-app-token
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 713d556d980ccb144eb6ae952cebc7b3963ed28c
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 15:05:44 2023 -0700
dependabot: bump actions/setup-java from 1 to 3 (#1035)
Bumps [actions/setup-java](https://github.com/actions/setup-java) from 1 to 3.
- [Release notes](https://github.com/actions/setup-java/releases)
- [Commits](https://github.com/actions/setup-java/compare/v1...v3)
---
updated-dependencies:
- dependency-name: actions/setup-java
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 574ac521653ede84e7b821bc3c06049f1054a6ad
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 10:53:02 2023 -0700
dependabot: bump tibdex/github-app-token from 1.5.0 to 2.0.0 (#1042)
Bumps [tibdex/github-app-token](https://github.com/tibdex/github-app-token) from 1.5.0 to 2.0.0.
- [Release notes](https://github.com/tibdex/github-app-token/releases)
- [Commits](https://github.com/tibdex/github-app-token/compare/v1.5.0...v2.0.0)
---
updated-dependencies:
- dependency-name: tibdex/github-app-token
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 65e207aef49a6872408ae02e4f49cdd9060c1ef0
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 10:52:40 2023 -0700
dependabot: bump org.apache.commons:commons-pool2 from 2.10.0 to 2.11.1 (#1045)
Bumps org.apache.commons:commons-pool2 from 2.10.0 to 2.11.1.
---
updated-dependencies:
- dependency-name: org.apache.commons:commons-pool2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit a4ff71926af39726d9b4584102706e3ea7f4fa05
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:16:31 2023 -0400
React to Tracer changes in TransportService (#1034)
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 05d0a3b905cae9d25f6d5d91f30f1b842b9a792f
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:14:20 2023 -0400
Ensure integ tests run with security after plugin rename (#1023)
* Ensure integ tests run with security after plugin rename
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Rename to time-series-analytics
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Switch folder back
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Run integTest with -i
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Remove opensearch-anomaly-detection if installed
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update password rules and change expected error msg
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update password generation
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Fix indexOf condition
Signed-off-by: Craig Perkins <cwperx@amazon.com>
---------
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 72210f014ab54bf4a5b567ebe9dabe13b66c6cbb
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:39 2023 -0700
dependabot: bump codecov/codecov-action from 1 to 3 (#1038)
Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 1 to 3.
- [Release notes](https://github.com/codecov/codecov-action/releases)
- [Changelog](https://github.com/codecov/codecov-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/codecov/codecov-action/compare/v1...v3)
---
updated-dependencies:
- dependency-name: codecov/codecov-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit b77c3a7406e94424550ec1f22f084bc20533994f
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:14 2023 -0700
dependabot: bump com.google.guava:guava from 32.0.1-jre to 32.1.2-jre (#1037)
Bumps [com.google.guava:guava](https://github.com/google/guava) from 32.0.1-jre to 32.1.2-jre.
- [Release notes](https://github.com/google/guava/releases)
- [Commits](https://github.com/google/guava/commits)
---
updated-dependencies:
- dependency-name: com.google.guava:guava
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 18defcc16e81abe590e8f109d6df3c4a060f74ce
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:03 2023 -0700
dependabot: bump VachaShah/backport from 1.1.4 to 2.2.0 (#1039)
Bumps [VachaShah/backport](https://github.com/vachashah/backport) from 1.1.4 to 2.2.0.
- [Release notes](https://github.com/vachashah/backport/releases)
- [Changelog](https://github.com/VachaShah/backport/blob/main/CHANGELOG.md)
- [Commits](https://github.com/vachashah/backport/compare/v1.1.4...v2.2.0)
---
updated-dependencies:
- dependency-name: VachaShah/backport
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 726759f104117e1a28648a1524cdface49168b79
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:53 2023 -0700
dependabot: bump actions/checkout from 2 to 4 (#1041)
Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v2...v4)
---
updated-dependencies:
- dependency-name: actions/checkout
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit f6ac01886a662264323d1e11a2199fb190148c80
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:38 2023 -0700
dependabot: bump org.jacoco:org.jacoco.ant from 0.8.5 to 0.8.10 (#1044)
Bumps [org.jacoco:org.jacoco.ant](https://github.com/jacoco/jacoco) from 0.8.5 to 0.8.10.
- [Release notes](https://github.com/jacoco/jacoco/releases)
- [Commits](https://github.com/jacoco/jacoco/compare/v0.8.5...v0.8.10)
---
updated-dependencies:
- dependency-name: org.jacoco:org.jacoco.ant
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit d30bcc394e6f281b6de504f102a0085ae56e78e4
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:22 2023 -0700
dependabot: bump org.junit.jupiter:junit-jupiter-api (#1043)
Bumps [org.junit.jupiter:junit-jupiter-api](https://github.com/junit-team/junit5) from 5.9.2 to 5.10.0.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/compare/r5.9.2...r5.10.0)
---
updated-dependencies:
- dependency-name: org.junit.jupiter:junit-jupiter-api
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 92256db92f9ed78cb1de9925297c9ff5cce6da74
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:04:23 2023 -0400
Add dependabot.yml (#1026)
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 23611f6d8ccdc9a4c41469ec0a4746290f976b4f
Author: Jackie Han <hnyng@amazon.com>
Date: Fri Sep 8 11:19:31 2023 -0700
Add 2.10 release notes (#1031)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit ee1db57058e08c36e4820637973f18016cf45015
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Wed Sep 6 16:55:00 2023 -0700
Updates demo certs for integ tests (#1018)
Signed-off-by: Owais Kazi <owaiskazi19@gmail.com>
commit 338d72eb692c81802a70fe42556cde70c01cad6a
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Sep 6 16:08:01 2023 -0700
refactor job response (#1017)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit db456c2543a6f1ff6b77db10bd19952768d16182
Author: Jackie Han <hnyng@amazon.com>
Date: Tue Sep 5 15:47:50 2023 -0700
upgrading commons-lang3 version to fix conflict issue (#1012)
* force commons-lang3 version to fix conflict issue
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from upstream version properties file
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* upgrading commons-lang3 version to align with core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit db788f4714233121eba4238869b8db89ae0037d4
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Tue Sep 5 13:58:31 2023 -0700
Adds auto release workflow (#1003)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 327c141e9b70465b1760f9ebf8c001a2e439b01f
Author: Jackie Han <hnyng@amazon.com>
Date: Fri Sep 1 13:00:23 2023 -0700
Revert "Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards (#948)" (#999)
This reverts commit bc1649922ef39619424fc16c64af5836e48a4a12.
commit 4a09b741e1c127a92775cb55f4c56aa5c4f3f6a3
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Aug 21 11:21:36 2023 -0700
Update Gradle Wrapper to 8.2.1 for Enhanced JDK20 Compatibility (#985)
- **Reason for Upgrade**: The migration to JDK20 ([reference](https://github.com/opensearch-project/opensearch-build/blob/aa65a8ecd69f77c3d3104043dd1c48dff708bffa/manifests/3.0.0/opensearch-3.0.0.yml#L9)) rendered the current Gradle version (7.6.1) incompatible.
- **Actions Taken**:
- **Gradle Wrapper Update**: Upgraded the Gradle wrapper to version 8.2.1 to maintain compatibility with JDK20. The gradle wrapper files are generated using the `./gradlew wrapper` command.
- Applied `spotless` due to new formatting requirements in Gradle 8.
- Resolved test "jar hell" issues. Gradle 8 introduced internal JARs to the test classpath that conflicted with dependencies from `org.junit.vintage:junit-vintage-engine`. As a remedy, these conflicting JARs have been excluded.
- **Relevant Pull Requests**:
- [Alerting#893](https://github.com/opensearch-project/alerting/pull/893/files)
- [ML-Commons#892](https://github.com/opensearch-project/ml-commons/pull/892)
- [Security PR](https://github.com/opensearch-project/security/pull/2978)
- **Verification**: Successfully verified the changes using `gradle build`.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 5ac6390e7de643d8177f0a5833995032f3a279ad
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Aug 17 11:08:36 2023 -0700
Refactoring task cache manager for forecasting (#982)
* Refactoring Shared Functionality for Broader Task Compatibility
This PR extracts shared components from `ADTaskCacheManager` into `TaskCacheManager` to support the requirements of the forecasting feature.
**Renamings**:
- **Method-level in `ADTaskCacheManager`**:
- `addDeletedDetector` to `addDeletedConfig`
- `addDeletedDetectorTask` to `addDeletedTask`
- `hasDeletedDetectorTask` to `hasDeletedTask`
- `pollDeletedDetector` to `pollDeletedConfig`
- `pollDeletedDetectorTask` to `pollDeletedTask`
- **Variable-level in `AnomalyDetectorSettings`**:
- `CHECKPOINT_MAINTAIN_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_MAINTAIN_QUEUE_MAX_HEAP_PERCENT`
- `CHECKPOINT_READ_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_READ_QUEUE_MAX_HEAP_PERCENT`
- `CHECKPOINT_SAVING_FREQ` to `AD_CHECKPOINT_SAVING_FREQ`
- `CHECKPOINT_TTL` to `AD_CHECKPOINT_TTL`
- `CHECKPOINT_WRITE_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_WRITE_QUEUE_MAX_HEAP_PERCENT`
- `COLD_ENTITY_QUEUE_MAX_HEAP_PERCENT` to `AD_COLD_ENTITY_QUEUE_MAX_HEAP_PERCENT`
- `DEDICATED_CACHE_SIZE` to `AD_DEDICATED_CACHE_SIZE`
- `ENTITY_COLD_START_QUEUE_CONCURRENCY` to `AD_ENTITY_COLD_START_QUEUE_CONCURRENCY`
- `ENTITY_COLD_START_QUEUE_MAX_HEAP_PERCENT` to `AD_ENTITY_COLD_START_QUEUE_MAX_HEAP_PERCENT`
- `EXPECTED_COLD_ENTITY_EXECUTION_TIME_IN_MILLISECS` to `AD_EXPECTED_COLD_ENTITY_EXECUTION_TIME_IN_MILLISECS`
- `FILTER_BY_BACKEND_ROLES` to `AD_FILTER_BY_BACKEND_ROLES`
- `MAX_ENTITIES_PER_QUERY` to `AD_MAX_ENTITIES_PER_QUERY`
- `MAX_MODEL_SIZE_PER_NODE` to `AD_MAX_MODEL_SIZE_PER_NODE`
- `MAX_MULTI_ENTITY_ANOMALY_DETECTORS` to `AD_MAX_HC_ANOMALY_DETECTORS`
- `MAX_RETRY_FOR_END_RUN_EXCEPTION` to `AD_MAX_RETRY_FOR_END_RUN_EXCEPTION`
- `MAX_SINGLE_ENTITY_ANOMALY_DETECTORS` to `AD_MAX_SINGLE_ENTITY_ANOMALY_DETECTORS`
- `MODEL_MAX_SIZE_PERCENTAGE` to `AD_MODEL_MAX_SIZE_PERCENTAGE`
- `PAGE_SIZE` to `AD_PAGE_SIZE`
- `RESULT_WRITE_QUEUE_MAX_HEAP_PERCENT` to `AD_RESULT_WRITE_QUEUE_MAX_HEAP_PERCENT`
- **Class-level**:
- `ADRealtimeTaskCache` renamed to `RealtimeTaskCache`
- **Package-level**:
- Shifted from `org.opensearch.ad.breaker` to `org.opensearch.timeseries.breaker`
**Migrations**:
- Variables transferred from `AnomalyDetectorSettings` to `TimeSeriesSettings`:
- `BATCH_BOUNDING_BOX_CACHE_RATIO`
- `CHECKPOINT_MAINTAIN_REQUEST_SIZE_IN_BYTES`
- `CHECKPOINT_WRITE_QUEUE_SIZE_IN_BYTES`
- `DEFAULT_AD_JOB_LOC_DURATION_SECONDS` (renamed to `DEFAULT_JOB_LOC_DURATION_SECONDS`)
- `ENTITY_REQUEST_SIZE_IN_BYTES`
- `HOURLY_MAINTENANCE`
- `INTERVAL_RATIO_FOR_REQUESTS`
- `LOW_SEGMENT_PRUNE_RATIO`
- `MAINTENANCE_FREQ_CONSTANT`
- `MAX_COLD_START_ROUNDS`
- `MAX_QUEUED_TASKS_RATIO`
- `MAX_TOTAL_RCF_SERIALIZATION_BUFFERS`
- `MAX_CHECKPOINT_BYTES`
- `MEDIUM_SEGMENT_PRUNE_RATIO`
- `NUM_MIN_SAMPLES`
- `NUM_SAMPLES_PER_TREE`
- `NUM_TREES`
- `QUEUE_MAINTENANCE`
- `RESULT_WRITE_QUEUE_SIZE_IN_BYTES`
- `SERIALIZATION_BUFFER_BYTES`
- `THRESHOLD_MIN_PVALUE`
- `TIME_DECAY`
**Deletions**:
- Obsolete settings and methods:
- `DESIRED_MODEL_SIZE_PERCENTAGE` in `AnomalyDetectorSettings`
- `getDesiredModelSize` in `MemoryTracker`
**Modifications**:
- `MemoryTracker` enums renamed for clear differentiation between real-time and historical memory usage, adding `REAL_TIME_FORECASTER` for a harmonized single-stream and HC analysis approach.
**Tests**:
- Changes validated with a successful Gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 0c5b4b94cb5b192160463fa8a5f58eac587fe95d
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Aug 15 13:09:17 2023 -0700
Update RCF to v3.8 and Enable Auto AD with 'Alert Once' Option (#979)
* Update RCF to v3.8 and Enable Auto AD with 'Alert Once' Option
This PR added support for automatic Anomaly Detection (AD) and the 'Alert Once' option introduced in RCF 3.8.
Testing done:
1. Deserialization Test:
* Verified model deserialization from 3.0-rc3.
* Ensured consistent scoring using the rc3 checkpoint and rc3 dependency on identical data.
2. Backward Compatibility Test:
* Executed a mixed cluster with versions 2.10 and 3.0.
* Validated that older detectors still produce results without throwing any exceptions in a blue-green simulation scenario.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* reduce recall since alertOnce reduced recall
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* remove commented out code
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit cadc9bbd949daf4f2669335bfb8629e2137c108d
Author: Joshua Palis <jpalis@amazon.com>
Date: Fri Aug 11 16:02:38 2023 -0700
Fixing imports, adding TermsAggregator BucketCountThresholds for StringTerms, setting AnomalyResult grade to 0 if negative value (#976)
Signed-off-by: Joshua Palis <jpalis@amazon.com>
commit 3985cd2f82f2cfa57604ecf5a512bb042e632cae
Author: Romain Tartière <romain@blogreen.org>
Date: Wed Aug 9 08:59:30 2023 -1000
Fix build with latest OpenSearch (for real this time) (#972)
This is a follow-up to #971, where commit
2839bc2c6f470639b68901086c80cb2152d96558 only fixed _some_ but not _all_
of the build errors (it allowed `./gradlew run` to pass but `./gradlew
build` was failing).
Fix the build errors when we run `./gradlew build`.
Signed-off-by: Romain Tartière <romain@blogreen.org>
commit 2839bc2c6f470639b68901086c80cb2152d96558
Author: Romain Tartière <romain@blogreen.org>
Date: Tue Aug 8 13:15:04 2023 -1000
Fix build with latest OpenSearch (#971)
OpenSearch recently merged some code that cause buid failure for this
module, as spotted in #585.
This change the import to match the new one after
https://github.com/opensearch-project/OpenSearch/pull/9103
Signed-off-by: Romain Tartière <romain@blogreen.org>
commit d4946f04e7ad44f0bc79215962c6678786c592ff
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Aug 7 14:21:56 2023 -0700
Refactor ADTask and Related Components (#969)
* Refactor ADTask and Related Components
This PR includes several key refactoring changes:
- Extracts common code from ADTask into TimeSeriesTask, creating ForecastTask for forecasting-specific logic.
- Consolidates common code from ADTaskType into TaskType and introduces ForecastTaskType for forecasting-related purposes.
- Renames ADTaskState to TaskState for consistent code reuse.
- Renames the method getId in ADTask to getConfigId to differentiate it from other IDs like task id.
Testing done:
1. Added unit tests for the new code to ensure functionality.
2. Executed a successful Gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* add comments and address compiler errors
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Amit's comments and address compiler failure
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 1130a1ba6fc3c08f375dd99f98e93e4ee36331fb
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jul 27 10:39:39 2023 -0700
Refactoring NodeStateManager etc. to support forecasting functionality (#965)
* Refactoring NodeStateManager etc. to support forecasting functionality
This commit extends the codebase to support both Anomaly Detection (AD) and forecasting. It contains a mixture of refactoring, renaming, removal of unused code, and package moving tasks. Here are the details:
Refactoring:
- `NodeStateManager.getAnomalyDetector` is now `getConfig`, with added functionality to fetch a Forecaster. The method comments are updated for clarity.
- Existing methods (`getFeatureSamplesForPeriods`, `getColdStartSamplesForPeriods`, `createPreviewSearchRequest`, `getMinDataTime`) have been added in `SearchFeatureDao` to handle forecasting logic.
- Adjusted `SecurityClientUtil` and `ParseUtils` to handle forecasting logic.
- Cleaned up `NodeState` to differentiate state for AD and forecasting.
Renaming:
- `AnomalyDetectorJob` is renamed to `Job` to facilitate reuse for forecasting.
- `NodeStateManager.getAnomalyDetectorJob` is renamed to `getJob`.
- Certain settings in `AnomalyDetectorSettings` are renamed to reflect they are meant for the AD setting. They have been marked as deprecated and new settings are used in `TimeSeriesSettings` instead.
- `IndexAnomalyDetectorJobActionHandler.getAnomalyDetectorJobForWrite` is renamed to `getJobForWrite`.
- `ADSafeSecurityInjector` is renamed to `TimeSeriesSafeSecurityInjector`.
Removing unused code:
- Synchronous code in `ClientUtil`, `IndexUtils`, and `CheckpointDao` is removed.
- The unused class `Throttler` is deleted.
- Mapping file names are changed, and the code referencing these files is adjusted.
Package moving:
- Several classes (`ClientUtil`, `MultiResponsesDelegateActionListener`, `SafeSecurityInjector`, `SecurityUtil`, `ExceptionUtil`, `SearchFeatureDao`, `CleanState`, `ExpiringState`, `MaintenanceState`, `NodeState`, `SingleStreamModelIdMapper`, `BackPressureRouting`) are moved to the respective `org.opensearch.timeseries` packages.
Miscellaneous:
- Fixed compiler failures caused by changes in https://github.com/opensearch-project/OpenSearch/pull/8730 by replacing `DoubleArrayList` with `java.util.ArrayList`.
- Updates the Backwards Compatibility (bwc) version to align with the core's incremented bwc version as per [OpenSearch PR #8670](https://github.com/opensearch-project/OpenSearch/pull/8670). This change prevents the issue described in [OpenSearch Issue #5076](https://github.com/opensearch-project/OpenSearch/issues/5076).
Testing:
- Executed a `gradle build`.
- Added new tests for `ClientUtil` and `NodeStateManager`.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comment
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* fix compiler error and comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit f0ed43b1aa3c5d80dc6f23a5dd4465bb03ef1739
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jul 17 15:18:03 2023 -0700
Rename AD to time series analytics & Resolve Compiler Errors (#951)
This commit focuses on renaming the AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin as well as addressing compiler errors due to package import changes. The primary transformations are:
* Renamed AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin.
* Updated all references from AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin.
* Amended plugin information in build.gradle and src/main/resources/es-plugin.properties.
* Switched job type in TimeSeriesAnalyticsPlugin from opendistro_anomaly_detector to opensearch_time_series_analytics.
These changes led to the modification of our plugin binary from opensearch-anomaly-detection-3.0.0.0-SNAPSHOT.jar to opensearch-time-series-analytics-3.0.0.0-SNAPSHOT.jar.
Moreover, following changes from OpenSearch Pull Request #8157, compiler errors were encountered, which were resolved by updating the import packages
* org.opensearch.common.io.stream.NamedWriteableRegistry => org.opensearch.core.common.io.stream.NamedWriteableRegistry
* org.opensearch.common.xcontent.XContentParserUtils => * org.opensearch.core.xcontent.XContentParserUtils
* org.opensearch.common.bytes.BytesArray => org.opensearch.core.common.bytes.BytesArray * org.opensearch.common.io.stream.StreamInput => * org.opensearch.core.common.io.stream.StreamInput ** org.opensearch.common.io.stream.StreamOutput => org.opensearch.core.common.io.stream.StreamOutput
* org.opensearch.common.io.stream.Writeable => org.opensearch.core.common.io.stream.Writeable
* org.opensearch.common.io.stream.NotSerializableExceptionWrapper => org.opensearch.core.common.io.stream.NotSerializableExceptionWrapper
* org.opensearch.rest.RestStatus => org.opensearch.core.rest.RestStatus
* org.opensearch.common.ParsingException => org.opensearch.core.common.ParsingException
* org.opensearch.common.bytes.BytesReference => org.opensearch.core.common.bytes.BytesReference
* org.opensearch.common.io.stream.InputStreamStreamInput => org.opensearch.core.common.io.stream.InputStreamStreamInput
* org.opensearch.common.io.stream.OutputStreamStreamOutput => org.opensearch.core.common.io.stream.OutputStreamStreamOutput
* org.opensearch.index.shard.ShardId => org.opensearch.core.index.shard.ShardId* org.opensearch.index.Index => org.opensearch.core.index.Index
* org.opensearch.core.index.IndexNotFoundException => org.opensearch.index.IndexNotFoundException
Validation steps were executed to ensure these changes did not break functionality:
* gradle build was successful. A local build was required due to outdated OpenSearch and job scheduler nightly builds.
* Backward compatibility tests were performed on a two-node 2.9 cluster running some detectors. These detectors continued to produce results on a 3.0 cluster with these updates.
* I can start new detectors on the 3.0 node.
* After shutting down a 2.9 node, the job transfer to the 3.0 node was successful and the job continued to perform as expected.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit c7c6a46e88e15f615fc9dae0499cf0d674662057
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Thu Jul 13 15:42:46 2023 -0700
Add 2.9 release notes (#952)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit bc1649922ef39619424fc16c64af5836e48a4a12
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Jul 11 13:34:09 2023 -0700
Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards (#948)
* Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards
In this PR, we temporarily enforce DOCUMENT replication for AD indices. This change is necessary due to the current limitation of SegRep, which doesn't support Get/MultiGet by ID. This measure will be in place until SegRep adds support for these operations.
This adjustment aligns with the modification made in the referenced PR: job-scheduler PR #417
Additionally, this PR increases the number of primary shards for forecasting indices from 10 to 20, recognizing the higher write intensity of these indices. For instance, when the horizon is 24, we are expected to save 25 documents: 24 for each forecast and 1 for the actual value. In contrast, for AD, we save one document per actual value.
Testing done:
1. gradle build passed
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Fix comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit a1203827617ee42b35d41cb8b010719f334f73b7
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jul 10 10:53:17 2023 -0700
Add ForecastResult and Refactor Shared Code (#941)
This commit adds the functionality of ForecastResult, while also performing several necessary refactorings.
Firstly, we introduce ForecastResult, which closely mirrors the functionality of AnomalyResult. Any shared code between these two classes has been abstracted out into a new parent class, IndexableResult. This refactoring was undertaken to facilitate code reuse and improve maintainability, as both classes deal with storing fields that need to be saved in result indices.
Secondly, we've also extracted common code from ThresholdingResult into another new class, IntermediateResult. This work is in preparation for a forthcoming PR which will introduce RCFCasterResult. In this change, we moved the 'toAnomalyResult' method to IndexableResult, and renamed it to 'toIndexableResults'. This renaming allows for reuse in the upcoming RCFCasterResult. The updated method now returns a list of results instead of a single result. The shift caters for the RCFCasterResult use case where one RCFCasterResult is stored across multiple ForecastResult documents.
Furthermore, this commit modifies the 'entity' field in several methods to be of the Optional type, indicating that it can be empty. This change provides a clear signal to other developers about the optional nature of these fields.
In addition, this commit updates the mapping for the forecast result index. The prior mapping was a placeholder and this change brings it up to date.
We've also moved to using httpcore5 and httpclient5 versions from OpenSearch core, as necessitated by recent changes in [OpenSearch PR #8434](https://github.com/opensearch-project/OpenSearch/pull/8434/files). This shift resolves potential jar hell issues with httpcore5 and httpclient5.
Lastly, we've made name and package changes:
1. Renamed 'initDetectionStateIndex' in ADIndexManagement to 'initStateIndex' to align with ForecastIndexManagement naming.
2. Moved the 'DataByFeatureId' class to the 'timeseries' package for better organization.
This commit also completes the 'createDummyIndexRequest' method in ForecastIndexManagement by invoking 'ForecastResult.getDummyResult()', which is now possible due to the introduction of the ForecastResult implementation.
Testing done:
1. added tests for new code
2. gralde build passes
3. e2e tests
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit f24d9e32ff739abf29cac3da15fd00f74219e213
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Thu Jul 6 17:28:09 2023 -0700
Bump scipy from 1.8.0 to 1.10.0 in /dataGeneration (#943)
Bumps [scipy](https://github.com/scipy/scipy) from 1.8.0 to 1.10.0.
- [Release notes](https://github.com/scipy/scipy/releases)
- [Commits](https://github.com/scipy/scipy/compare/v1.8.0...v1.10.0)
---
updated-dependencies:
- dependency-name: scipy
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 9b9fd2ba3f3e678d717c0a45af8069bb67828808
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Jun 27 16:08:55 2023 -0700
bump guava version to 32.0.1 (#933)
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit 99749dfa6bfc8a2f2c4660ca01d75d1ad57124a5
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jun 26 16:46:24 2023 -0700
Refactoring Index Creation for Improved Code Reuse and Consistency (#932)
This Pull Request significantly refactors the index creation module to promote greater code reusability and consistency. The primary changes are outlined as follows:
1. Code Migration: Common code segments have been moved from AnomalyDetectionIndices to IndexManagement. In addition, component-specific code has been established in ADIndexManagement and ForecastIndexManagement. The bulk of changes are concentrated in these three classes, with the remainder of the modifications relating to reference/test changes.
2. Function Renaming: Several functions have been renamed for broader applicability and consistency:
* AnomalyDetectorFunction has been renamed to ExecutorFunction for potential use in Forecasting.
* AnomalyDetectorSettings.MAX_PRIMARY_SHARDS has been renamed to AnomalyDetectorSettings.AD_MAX_PRIMARY_SHARDS in light of the new ForecastSettings.FORECAST_MAX_PRIMARY_SHARDS.
* doesAnomalyDetectorJobIndexExist() has been renamed to doesJobIndexExist() to allow for job index reusability across Anomaly Detection (AD) and forecasting. Analogous changes have been made to other job index-related functions.
* doesAnomalyDetectorIndexExist() has been renamed to doesConfigIndexExist() to allow for config index reusability across AD and forecasting. Analogous changes have been made to other config index-related functions.
* detectionIndices.doesDetectorStateIndexExist() has been renamed to detectionIndices.doesStateIndexExist(), as the former name was unnecessarily redundant. Similar modifications have been made to the result and checkpoint index.
3. Class Migration: The classes ThrowingSupplierWrapper, ThrowingConsumer, and ThrowingSupplier have been moved from org.opensearch.ad.util to org.opensearch.timeseries.function to promote code reuse.
4. Initial Forecast Indices' Mapping: An initial version of forecast indices' mapping has been added, which can be adjusted as required in the future.
5. In terms of version updates, 2.x has been bumped to 2.9, prompting an increment of the Backward Compatibility (BWC) test version to 2.9.
6. Update dependency com.google.guava:guava to v32 for cve fix.
Testing done:
Testing has been performed with new tests added for forecast index creation, and the grade build passes successfully.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit aedb781a6b1df984636d72d50b65d41138539918
Author: Craig Perkins <craig5008@gmail.com>
Date: Tue Jun 20 16:55:19 2023 -0400
Fix main build - update import of Releasable and remove reference to BaseExceptionsHelper (#930)
* Fix main build - update import of Releasable and remove reference to BaseExceptionsHelper
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update imports in test classes
Signed-off-by: Craig Perkins <cwperx@amazon.com>
---------
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit fce78c29c0375ae06f56e16c85fb98933401e28f
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Jun 14 10:36:40 2023 -0700
Refactor: Reorganize code for Forecasting and AnomalyDetector packages (#925)
* Refactor: Reorganize code for Forecasting and AnomalyDetector packages
This PR includes several refactorings to increase code reuse and improve readability:
1. Entity, FeatureData, and RestHandlerUtils have been moved from the 'ad' package to the 'timeseries' package, enabling their use within the Forecasting code.
2. A new class, DataByFeatureId, has been created to hold shared code previously located in FeatureData. FeatureData now inherits from DataByFeatureId. The standalone usage of DataByFeatureId will be detailed in subsequent PRs.
3. Renamed checkAnomalyDetectorFeaturesSyntax to checkFeaturesSyntax in RestHandlerUtils to make it more generic and usable for Forecasting.
4. Constants AGG_NAME_MAX_TIME, AGG_NAME_MIN_TIME, DATE_HISTOGRAM, and FEATURE_AGGS have been moved from ADCommonName to CommonName to make them accessible for Forecasting.
5. A new method, parseConfig, has been added to the Config class. This method can parse configuration for either AnomalyDetector or Forecaster based on input.
Testing:
The changes have been validated with a successful gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Amit and Owais's comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 02c120f025f73f3d45a8477c7ef8b4873befebfa
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jun 12 11:54:39 2023 -0700
Updated Maintainers and CODE_OWNERS list (#926)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 2ea4dcf430b40a710a0babb04881eeff9fb2d689
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jun 8 15:11:44 2023 -0700
Add Forecaster class (#920)
* Add Forecaster class
This PR adds class Forecaster that serves as the configuration POJO for forecasting. Shared code between AnomalyDetector and Forecaster is extracted and moved to the Config class to reduce duplication and promote reusability. References to the common code in related classes have also been adjusted.
Testing done:
1. gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* fix compiler error due to a recent core change
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Sudipto and Amit's comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit ee04225349a5f0f003d56e77a3243386f4a9673d
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri Jun 2 15:42:19 2023 -0700
Refactor: Migrate files from 'ad' to 'timeseries' package (#918)
* Refactor: Migrate files from 'ad' to 'timeseries' package
This commit involves moving various files from the 'ad' package to the 'timeseries' package. All changes to dependent imports were handled automatically through the IDE, and no changes to file contents were made in the process.
Testing done:
- gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* move ParseUtils to util package
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 472868d165c2234eece8827584f64086aaf7ae92
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jun 1 11:17:16 2023 -0700
Refactor Shared Settings, Introduce Dynamic Forecast Settings, Rename (#912)
* Refactor Shared Settings, Introduce Dynamic Forecast Settings, and Rename Checkpoint mapping File
This commit has undertaken three changes:
* Refactoring of Shared Settings: I've performed a refactoring to unify the settings that are shared between the AD and forecasting modules.
* Introduction of Dynamic Forecast Settings: To increase the adaptability of our system, I've implemented dynamic forecast settings. These settings mirror the existing structure of the AD dynamic settings and will enable us to adjust forecast settings on-the-fly.
* Renaming of Checkpoint File: To enhance the consistency across our AD mapping files, I've renamed checkpoint.json to anomaly-checkpoint.java.
Testing done:
1. added tests for new settings.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* name change and delete files
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 04ab91e60e9d71765a7b9df10b86e0e53ba4d715
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 31 12:18:54 2023 -0700
add 2.8 release notes (#915)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 98da8dffe8d336793ae35658015650b0f83aeef1
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 24 14:37:38 2023 -0700
Implementing Multiple Imputation Methods for Missing Values (#907)
* Implementing Multiple Imputation Methods for Missing Values
This Pull Request introduces multiple imputation methods to handle missing data in Anomaly Detection (AD) and forecasting. The ability to handle missing data is crucial to improve the robustness and accuracy of our models.
The following imputation methods have been implemented:
* Zero Imputation (ZERO): This method replaces all missing values with 0's. It's a simple approach, but it may introduce bias if the data is not centered around zero.
* Fixed Values Imputation (FIXED_VALUES): This method replaces missing values with a predefined set of values. The values are the same for each input dimension, and they need to be specified by the user.
* Previous Value Imputation (PREVIOUS): This method replaces missing values with the last known value in the respective input dimension. It's a commonly used method for time series data, where temporal continuity is expected.
* Linear Interpolation (LINEAR): This method estimates missing values by interpolating linearly between known values in the respective input dimension. This method assumes that the data follows a linear trend.
These methods are designed to provide a set of options for users to handle missing data based on their specific needs and the nature of their data.
Testing Done:
The code changes in this pull request have been validated through a gradle build to ensure that all new and existing tests pass successfully.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Various changes
The commit makes all new files use the shortened header text and addresses compiler/test issues due to core refactoring
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit da608aaa3d3f955efe32b0cb33b3c8cfdd7a7718
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue May 16 11:37:34 2023 -0700
Code Refactoring for CommonMessages (#902)
* Code Refactoring for CommonMessages
In this pull request, I have refactored the code related to shared log or error messages in both AD and forecasting modules to CommonMessages. Additionally, the previously used CommonErrorMessages has been renamed to ADCommonMessages. For the Forecasting module, I have introduced new names in ForecastCommonMessages.
Testing done:
* gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Update string constants wording
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve wording and remove redundant variables
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 041d6ce73d37f1697013b2d2f0683fbfe012247c
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri May 12 13:05:56 2023 -0700
Code Refactoring for CommonName (#901)
In this pull request, I have refactored the code related to shared names in both AD and forecasting modules to CommonNames. Additionally, the previously used CommonName has been renamed to ADCommonName. For the Forecasting module, I have introduced new names in ForecastCommonNames.
Testing done:
* gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit e2fee9d6ba59cc2a23eadbb50a80414fcc7dbf8f
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 10 17:26:31 2023 -0700
Update outdated MAINTAINERS and OWNERS list (#898)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 98b566d1ec57ffd8970b5180c54b493deb1a24ac
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Wed May 10 18:03:04 2023 -0400
Sync up CODEOWNERS with MAINTAINERS.md. (#897)
Signed-off-by: dblock <dblock@amazon.com>
commit 1f8415aa39fa4ec3ba016214255aa0e79b7c7d63
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue May 9 12:55:35 2023 -0700
Various fixes (#886)
* Various fixes
This pull request addresses several issues related to the compiler and tests in the current main branch.
The first major change involves replacing ImmutableOpenMap with java.util.Map in the core. This modification is implemented in the following pull requests:
https://github.com/opensearch-project/OpenSearch/pull/7165
https://github.com/opensearch-project/OpenSearch/pull/7301
To accommodate this change, the codebase of the AD (Anomaly Detection) module has been refactored to utilize JDK maps. As a consequence of this change, passing null to the custom parameters of ClusterState is no longer permissible, as it leads to a NullPointerException. The error stack trace is as follows:
java.lang.NullPointerException: Cannot invoke "Object.getClass()" because "m" is null
at __randomizedtesting.SeedInfo.seed([60CDDB34427ACD0C:6E72DB4ED18E018D]:0)
at java.base/java.util.Collections.unmodifiableMap(Collections.java:1476)
at org.opensearch.cluster.ClusterState.<init>(ClusterState.java:219)
at org.opensearch.ad.transport.DeleteAnomalyDetectorTests.createClusterState(DeleteAnomalyDetectorTests.java:216)
at org.opensearch.ad.transport.DeleteAnomalyDetectorTests.testDeleteADTransportAction_LatestDetectorLevelTask(DeleteAnomalyDetectorTests.java:160)
To address this issue, we have replaced the usage of null with new HashMap<>().
The second change in this pull request aligns with the modifications introduced in PR https://github.com/opensearch-project/anomaly-detection/pull/878.
The third issue is related to the incompatibility between tests that utilize the @Parameters annotation and those that do not, as explained in https://tinyurl.com/2y265s2w. Specifically, the SearchFeatureDaoTests class runes tests with the @Parameters annotation, whereas SearchFeatureDao tests do not.
Testing done:
1. gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 0a48da9e1a0cd70c64cc2da228674baaf377c89e
Author: Jackie Han <hnyng@amazon.com>
Date: Mon Apr 17 12:44:06 2023 -0700
Add 2.7 release notes (#871)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 1edc2ef1ccfe20938711984744b20d1f2ec96a3c
Author: Jackie Han <hnyng@amazon.com>
Date: Tue Apr 11 17:53:57 2023 -0700
Update OpenSearchRejectedExecutionException import (#861)
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update NodeInfo constructor and javadoc for isAdmin method
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit b8df172c2364997c446096e960068d6fc5d2e6f6
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Apr 11 10:55:28 2023 -0700
Giving admin priority over backendrole filtering (#850)
* giving admin priority over backend role filtering
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
* fix security tests
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
* remove redundent line in test case
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
---------
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit fd2fd5d5f63c9004b9f265e3c1e4475282447da8
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Thu Mar 16 14:30:32 2023 -0400
Created untriaged issue workflow. (#809)
Signed-off-by: dblock <dblock@amazon.com>
commit fd547014fdde5114bbc9c8e49fe7aaa37eb6e793
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Mar 1 16:41:05 2023 -0800
Publish snapshots to maven via GHA, fix spotless errors, and bump bwc version (#827)
We are de-coupling the task of publishing the maven snapshots from centralized build workflow to individual repositories. This PR publishes maven snapshots using GitHub Actions.
Testing done:
1. ran ./gradlew publishPluginZipPublicationToSnapshotsRepository according to https://github.com/opensearch-project/anomaly-detection/issues/813
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit b6be5960fb8cff41f0e9d13d5f5a971c289b80ed
Author: Jackie Han <hnyng@amazon.com>
Date: Thu Feb 23 12:23:01 2023 -0800
Update xcontent imports (#822)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 1dcb78a6c4d1331133aefe5af7adf137daa8846f
Author: Jackie Han <hnyng@amazon.com>
Date: Wed Feb 22 11:17:21 2023 -0800
Add 2.6 release note (#818)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 553688aae45590c37cc4d86102642d0b3a6ebb33
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Feb 9 13:38:14 2023 -0800
Revert changes to exception message (#803)
* Revert changes to exception message
We used to log "No RCF models are available either because RCF models are not ready..." and now we log "resource_not_found_exception: No checkpoints found for model id...". This change caused an integration test failure. This PR reverts it back.
Testing done:
1. verified that the original log is back.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* check NO_MODEL_ERR_MSG instead of NO_CHECKPOINT_ERR_MSG
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit c9bdc628a03c4ced3cd1ebeec44ebff792d7ff98
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri Feb 3 11:15:37 2023 -0800
fixing dls/fls logic around numeric aggregations (#801)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 9cebc5bc97a84dd78ac8892863ff7d674428bced
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Jan 10 02:17:04 2023 +0000
adding 2.5 release notes
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit 2ace84643fd199a5e5179e6d21ab76ae212cb7d8
Author: Ryan Bogan <10944539+ryanbogan@users.noreply.github.com>
Date: Tue Jan 10 13:31:49 2023 -0800
Add jackson back to build.gradle (#780)
Signed-off-by: Ryan Bogan <rbogan@amazon.com>
commit a5d60eefab5ac30ef5243da8e7a88b7a2189cd5c
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jan 9 15:49:35 2023 -0800
bump bwc to 2.6.0 (#775)
We need to bump the version because only the latest 2.x will be upgradable to 3.0 when that ship. Since OpenSearch core bumped to 2.6, we need to do that as well. Note after bumping version, bwc still fails to find 2.6.0 core zip.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 27ed49863bfbef90551cdfacc6b51703bf622e25
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jan 9 12:17:57 2023 -0800
Fix the discrepancy between Profile API and real time tasks API (#770)
* Fix the discrepancy between Profile API and real time tasks API
This PR fixes the discrepancy by querying the result index when the total updates is less than 32. We have done similar things in profile API so I refactored reusable code to ProfileUtil. We also cached whether we have queried the result index and won't repeatedly issue the extra query.
Testing done:
1. repeated repro steps in https://github.com/opensearch-project/anomaly-detection/issues/502 and verified the issue has been resolved.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit b49a36b3e7962a205695d451e0497ee4f57fb2cb
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Thu Jan 5 10:19:51 2023 -0800
Updated MAIN…
kaituo
added a commit
to kaituo/anomaly-detection-1
that referenced
this pull request
Mar 27, 2024
commit 303ceb5b320f148dcd015ab6a11f870ae3e23125
Author: Joshua Palis <jpalis@amazon.com>
Date: Mon Mar 18 16:49:59 2024 -0700
Adding 2.13 release notes (#1170)
Signed-off-by: Joshua Palis <jpalis@amazon.com>
commit 1507dd4b4045bd8e8cdf505d07041ce304788ca0
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Feb 21 15:59:34 2024 -0800
Inject NamedWriteableRegistry in AD node client (#1164)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 5b85720d442d1b43001dde0c20248fd4a20a64b0
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Tue Feb 13 10:20:20 2024 -0800
Fixed lucene url (#1158)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 290bdcd832a0cae6d039787d9f0af73ea6be2ec2
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Feb 6 16:14:49 2024 -0800
add 2.12 release notes (#1152)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 6a6eec347379c997f0f7acc88b027bc1ffdd8f54
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Tue Jan 30 18:20:36 2024 -0800
Add ser/deser to get AD transport action request (#1150)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 475f0c36e5b6267aaeb101627b9c3ae1fcca3a88
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Thu Jan 25 14:37:12 2024 -0800
Updated lucene snapshot url (#1146)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 7192d848d2923566a409901909f342a63695e1c2
Author: Jackie Han <hnyng@amazon.com>
Date: Thu Jan 25 09:48:37 2024 -0800
Remove default admin credentials (#1134)
* Remove default admin credentials
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Replace default password with a placeholder in README files
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 97482c19b0eded34a7f435e589303a834c258aa3
Author: Jackie Han <hnyng@amazon.com>
Date: Wed Jan 24 09:39:55 2024 -0800
Require JDK version for java spotless check (#1129)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 708e0462189677a217b35905c2feba5486c77cdc
Author: Andriy Redko <andriy.redko@aiven.io>
Date: Tue Jan 23 15:11:39 2024 -0500
Update to Jackson 2.16.1 (#1135)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
commit 7c0ce4cb554a05230ecf5365b903219f357997bf
Author: Andriy Redko <drreta@gmail.com>
Date: Tue Jan 16 17:51:37 2024 -0500
Update to Gradle 8.5 (#1131)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
commit e5cbe93c0e9cadebe2a30cba83f99ae8a3f8fe57
Author: zane-neo <zaniu@amazon.com>
Date: Thu Jan 4 16:50:47 2024 +0800
add publishToMavenLocal task to fix zip plugin not pulished to maven local issue when running this script (#1121)
Signed-off-by: zane-neo <zaniu@amazon.com>
commit 106dc25b3ef36beae329dc7882bcdf9c23347fb5
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Dec 27 16:33:25 2023 -0800
Refactor client's getDetectorProfile to use GetAnomalyDetectorTransportAction (#1124)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 59b4ebecfa11cac977f49c999ce85637fb6fac58
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Dec 27 11:56:00 2023 -0800
Add profile transport action to AD client (#1119)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 29711f96dbb2c9abc1181b933a8b334eed63ca66
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Tue Dec 12 08:32:53 2023 -0800
Add an AD transport client (#1110)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 353dcaeb05f8b75fa74d92e2ae8415ab018bc68e
Author: Daniel Widdis <widdis@gmail.com>
Date: Wed Nov 22 13:59:53 2023 -0800
Fix build, update CVE-affected versions (#1102)
* Fix build, update CVE-affected versions
Signed-off-by: Daniel Widdis <widdis@gmail.com>
* Spotless depends on CVE-impacted eclipse dependency, now needs JDK17+
Signed-off-by: Daniel Widdis <widdis@gmail.com>
---------
Signed-off-by: Daniel Widdis <widdis@gmail.com>
commit 4c6ba48bf9fb9234ad8bc0b9193f3c68409acfb9
Author: Peter Zhu <zhujiaxi@amazon.com>
Date: Mon Oct 30 19:35:01 2023 -0400
Fix the bwc test version retrieval (#1093)
* Onboarding jenkins prod docker images to github actions
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
---------
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
commit a1da3aa0eefc6671446d2eb3bc670bad6449d2f0
Author: Peter Zhu <zhujiaxi@amazon.com>
Date: Mon Oct 30 19:14:31 2023 -0400
Onboarding jenkins prod docker images to github actions (#1092)
* Onboarding jenkins prod docker images to github actions
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
---------
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
commit 040cd7e33f8e696ffe7748140c9b0ecc7475d513
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:43:02 2023 -0700
dependabot: bump net.bytebuddy:byte-buddy from 1.14.6 to 1.14.9 (#1081)
Bumps [net.bytebuddy:byte-buddy](https://github.com/raphw/byte-buddy) from 1.14.6 to 1.14.9.
- [Release notes](https://github.com/raphw/byte-buddy/releases)
- [Changelog](https://github.com/raphw/byte-buddy/blob/master/release-notes.md)
- [Commits](https://github.com/raphw/byte-buddy/compare/byte-buddy-1.14.6...byte-buddy-1.14.9)
---
updated-dependencies:
- dependency-name: net.bytebuddy:byte-buddy
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit dd9c1521bc1946027245d65e39a7844cdf04a8b7
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:42:15 2023 -0700
dependabot: bump aws-actions/configure-aws-credentials (#1076)
Bumps [aws-actions/configure-aws-credentials](https://github.com/aws-actions/configure-aws-credentials) from 1.7.0 to 4.0.1.
- [Release notes](https://github.com/aws-actions/configure-aws-credentials/releases)
- [Changelog](https://github.com/aws-actions/configure-aws-credentials/blob/main/CHANGELOG.md)
- [Commits](https://github.com/aws-actions/configure-aws-credentials/compare/v1.7.0...v4.0.1)
---
updated-dependencies:
- dependency-name: aws-actions/configure-aws-credentials
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit d6e3fd7a69b1daea45d7a455335e55b6de118033
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:05:00 2023 -0700
dependabot: bump com.netflix.nebula.ospackage from 11.0.0 to 11.5.0 (#1066)
Bumps com.netflix.nebula.ospackage from 11.0.0 to 11.5.0.
---
updated-dependencies:
- dependency-name: com.netflix.nebula.ospackage
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 57eacf611ce44559e14aa37f2e51dfbb82d53cc2
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:04:19 2023 -0700
dependabot: bump org.apiguardian:apiguardian-api from 1.1.0 to 1.1.2 (#1058)
Bumps [org.apiguardian:apiguardian-api](https://github.com/apiguardian-team/apiguardian) from 1.1.0 to 1.1.2.
- [Release notes](https://github.com/apiguardian-team/apiguardian/releases)
- [Commits](https://github.com/apiguardian-team/apiguardian/compare/r1.1.0...r1.1.2)
---
updated-dependencies:
- dependency-name: org.apiguardian:apiguardian-api
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 6b9faf2b71e5481be366b12bd6f16440c6c8ef89
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:04:01 2023 -0700
dependabot: bump org.junit.platform:junit-platform-launcher (#1056)
Bumps [org.junit.platform:junit-platform-launcher](https://github.com/junit-team/junit5) from 1.9.2 to 1.10.0.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/commits)
---
updated-dependencies:
- dependency-name: org.junit.platform:junit-platform-launcher
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 2a957f2086688b5ee76703406105797d31207cc5
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:03:11 2023 -0700
Bump urllib3 from 1.26.9 to 1.26.17 in /dataGeneration (#1068)
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.9 to 1.26.17.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.9...1.26.17)
---
updated-dependencies:
- dependency-name: urllib3
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit a12e33214f9c138946975801cefa2bd39c7978a9
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 11:29:37 2023 -0700
dependabot: bump org.objenesis:objenesis from 3.0.1 to 3.3 (#1040)
Bumps [org.objenesis:objenesis](https://github.com/easymock/objenesis) from 3.0.1 to 3.3.
- [Release notes](https://github.com/easymock/objenesis/releases)
- [Commits](https://github.com/easymock/objenesis/compare/3.0.1...3.3)
---
updated-dependencies:
- dependency-name: org.objenesis:objenesis
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 5a4ba14a431fbc53f757416542cda25ef2fae58c
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 11:28:46 2023 -0700
dependabot: bump tibdex/github-app-token from 2.0.0 to 2.1.0 (#1065)
Bumps [tibdex/github-app-token](https://github.com/tibdex/github-app-token) from 2.0.0 to 2.1.0.
- [Release notes](https://github.com/tibdex/github-app-token/releases)
- [Commits](https://github.com/tibdex/github-app-token/compare/v2.0.0...v2.1.0)
---
updated-dependencies:
- dependency-name: tibdex/github-app-token
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 713d556d980ccb144eb6ae952cebc7b3963ed28c
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 15:05:44 2023 -0700
dependabot: bump actions/setup-java from 1 to 3 (#1035)
Bumps [actions/setup-java](https://github.com/actions/setup-java) from 1 to 3.
- [Release notes](https://github.com/actions/setup-java/releases)
- [Commits](https://github.com/actions/setup-java/compare/v1...v3)
---
updated-dependencies:
- dependency-name: actions/setup-java
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 574ac521653ede84e7b821bc3c06049f1054a6ad
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 10:53:02 2023 -0700
dependabot: bump tibdex/github-app-token from 1.5.0 to 2.0.0 (#1042)
Bumps [tibdex/github-app-token](https://github.com/tibdex/github-app-token) from 1.5.0 to 2.0.0.
- [Release notes](https://github.com/tibdex/github-app-token/releases)
- [Commits](https://github.com/tibdex/github-app-token/compare/v1.5.0...v2.0.0)
---
updated-dependencies:
- dependency-name: tibdex/github-app-token
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 65e207aef49a6872408ae02e4f49cdd9060c1ef0
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 10:52:40 2023 -0700
dependabot: bump org.apache.commons:commons-pool2 from 2.10.0 to 2.11.1 (#1045)
Bumps org.apache.commons:commons-pool2 from 2.10.0 to 2.11.1.
---
updated-dependencies:
- dependency-name: org.apache.commons:commons-pool2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit a4ff71926af39726d9b4584102706e3ea7f4fa05
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:16:31 2023 -0400
React to Tracer changes in TransportService (#1034)
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 05d0a3b905cae9d25f6d5d91f30f1b842b9a792f
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:14:20 2023 -0400
Ensure integ tests run with security after plugin rename (#1023)
* Ensure integ tests run with security after plugin rename
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Rename to time-series-analytics
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Switch folder back
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Run integTest with -i
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Remove opensearch-anomaly-detection if installed
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update password rules and change expected error msg
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update password generation
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Fix indexOf condition
Signed-off-by: Craig Perkins <cwperx@amazon.com>
---------
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 72210f014ab54bf4a5b567ebe9dabe13b66c6cbb
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:39 2023 -0700
dependabot: bump codecov/codecov-action from 1 to 3 (#1038)
Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 1 to 3.
- [Release notes](https://github.com/codecov/codecov-action/releases)
- [Changelog](https://github.com/codecov/codecov-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/codecov/codecov-action/compare/v1...v3)
---
updated-dependencies:
- dependency-name: codecov/codecov-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit b77c3a7406e94424550ec1f22f084bc20533994f
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:14 2023 -0700
dependabot: bump com.google.guava:guava from 32.0.1-jre to 32.1.2-jre (#1037)
Bumps [com.google.guava:guava](https://github.com/google/guava) from 32.0.1-jre to 32.1.2-jre.
- [Release notes](https://github.com/google/guava/releases)
- [Commits](https://github.com/google/guava/commits)
---
updated-dependencies:
- dependency-name: com.google.guava:guava
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 18defcc16e81abe590e8f109d6df3c4a060f74ce
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:03 2023 -0700
dependabot: bump VachaShah/backport from 1.1.4 to 2.2.0 (#1039)
Bumps [VachaShah/backport](https://github.com/vachashah/backport) from 1.1.4 to 2.2.0.
- [Release notes](https://github.com/vachashah/backport/releases)
- [Changelog](https://github.com/VachaShah/backport/blob/main/CHANGELOG.md)
- [Commits](https://github.com/vachashah/backport/compare/v1.1.4...v2.2.0)
---
updated-dependencies:
- dependency-name: VachaShah/backport
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 726759f104117e1a28648a1524cdface49168b79
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:53 2023 -0700
dependabot: bump actions/checkout from 2 to 4 (#1041)
Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v2...v4)
---
updated-dependencies:
- dependency-name: actions/checkout
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit f6ac01886a662264323d1e11a2199fb190148c80
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:38 2023 -0700
dependabot: bump org.jacoco:org.jacoco.ant from 0.8.5 to 0.8.10 (#1044)
Bumps [org.jacoco:org.jacoco.ant](https://github.com/jacoco/jacoco) from 0.8.5 to 0.8.10.
- [Release notes](https://github.com/jacoco/jacoco/releases)
- [Commits](https://github.com/jacoco/jacoco/compare/v0.8.5...v0.8.10)
---
updated-dependencies:
- dependency-name: org.jacoco:org.jacoco.ant
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit d30bcc394e6f281b6de504f102a0085ae56e78e4
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:22 2023 -0700
dependabot: bump org.junit.jupiter:junit-jupiter-api (#1043)
Bumps [org.junit.jupiter:junit-jupiter-api](https://github.com/junit-team/junit5) from 5.9.2 to 5.10.0.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/compare/r5.9.2...r5.10.0)
---
updated-dependencies:
- dependency-name: org.junit.jupiter:junit-jupiter-api
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 92256db92f9ed78cb1de9925297c9ff5cce6da74
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:04:23 2023 -0400
Add dependabot.yml (#1026)
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 23611f6d8ccdc9a4c41469ec0a4746290f976b4f
Author: Jackie Han <hnyng@amazon.com>
Date: Fri Sep 8 11:19:31 2023 -0700
Add 2.10 release notes (#1031)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit ee1db57058e08c36e4820637973f18016cf45015
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Wed Sep 6 16:55:00 2023 -0700
Updates demo certs for integ tests (#1018)
Signed-off-by: Owais Kazi <owaiskazi19@gmail.com>
commit 338d72eb692c81802a70fe42556cde70c01cad6a
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Sep 6 16:08:01 2023 -0700
refactor job response (#1017)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit db456c2543a6f1ff6b77db10bd19952768d16182
Author: Jackie Han <hnyng@amazon.com>
Date: Tue Sep 5 15:47:50 2023 -0700
upgrading commons-lang3 version to fix conflict issue (#1012)
* force commons-lang3 version to fix conflict issue
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from upstream version properties file
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* upgrading commons-lang3 version to align with core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit db788f4714233121eba4238869b8db89ae0037d4
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Tue Sep 5 13:58:31 2023 -0700
Adds auto release workflow (#1003)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 327c141e9b70465b1760f9ebf8c001a2e439b01f
Author: Jackie Han <hnyng@amazon.com>
Date: Fri Sep 1 13:00:23 2023 -0700
Revert "Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards (#948)" (#999)
This reverts commit bc1649922ef39619424fc16c64af5836e48a4a12.
commit 4a09b741e1c127a92775cb55f4c56aa5c4f3f6a3
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Aug 21 11:21:36 2023 -0700
Update Gradle Wrapper to 8.2.1 for Enhanced JDK20 Compatibility (#985)
- **Reason for Upgrade**: The migration to JDK20 ([reference](https://github.com/opensearch-project/opensearch-build/blob/aa65a8ecd69f77c3d3104043dd1c48dff708bffa/manifests/3.0.0/opensearch-3.0.0.yml#L9)) rendered the current Gradle version (7.6.1) incompatible.
- **Actions Taken**:
- **Gradle Wrapper Update**: Upgraded the Gradle wrapper to version 8.2.1 to maintain compatibility with JDK20. The gradle wrapper files are generated using the `./gradlew wrapper` command.
- Applied `spotless` due to new formatting requirements in Gradle 8.
- Resolved test "jar hell" issues. Gradle 8 introduced internal JARs to the test classpath that conflicted with dependencies from `org.junit.vintage:junit-vintage-engine`. As a remedy, these conflicting JARs have been excluded.
- **Relevant Pull Requests**:
- [Alerting#893](https://github.com/opensearch-project/alerting/pull/893/files)
- [ML-Commons#892](https://github.com/opensearch-project/ml-commons/pull/892)
- [Security PR](https://github.com/opensearch-project/security/pull/2978)
- **Verification**: Successfully verified the changes using `gradle build`.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 5ac6390e7de643d8177f0a5833995032f3a279ad
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Aug 17 11:08:36 2023 -0700
Refactoring task cache manager for forecasting (#982)
* Refactoring Shared Functionality for Broader Task Compatibility
This PR extracts shared components from `ADTaskCacheManager` into `TaskCacheManager` to support the requirements of the forecasting feature.
**Renamings**:
- **Method-level in `ADTaskCacheManager`**:
- `addDeletedDetector` to `addDeletedConfig`
- `addDeletedDetectorTask` to `addDeletedTask`
- `hasDeletedDetectorTask` to `hasDeletedTask`
- `pollDeletedDetector` to `pollDeletedConfig`
- `pollDeletedDetectorTask` to `pollDeletedTask`
- **Variable-level in `AnomalyDetectorSettings`**:
- `CHECKPOINT_MAINTAIN_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_MAINTAIN_QUEUE_MAX_HEAP_PERCENT`
- `CHECKPOINT_READ_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_READ_QUEUE_MAX_HEAP_PERCENT`
- `CHECKPOINT_SAVING_FREQ` to `AD_CHECKPOINT_SAVING_FREQ`
- `CHECKPOINT_TTL` to `AD_CHECKPOINT_TTL`
- `CHECKPOINT_WRITE_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_WRITE_QUEUE_MAX_HEAP_PERCENT`
- `COLD_ENTITY_QUEUE_MAX_HEAP_PERCENT` to `AD_COLD_ENTITY_QUEUE_MAX_HEAP_PERCENT`
- `DEDICATED_CACHE_SIZE` to `AD_DEDICATED_CACHE_SIZE`
- `ENTITY_COLD_START_QUEUE_CONCURRENCY` to `AD_ENTITY_COLD_START_QUEUE_CONCURRENCY`
- `ENTITY_COLD_START_QUEUE_MAX_HEAP_PERCENT` to `AD_ENTITY_COLD_START_QUEUE_MAX_HEAP_PERCENT`
- `EXPECTED_COLD_ENTITY_EXECUTION_TIME_IN_MILLISECS` to `AD_EXPECTED_COLD_ENTITY_EXECUTION_TIME_IN_MILLISECS`
- `FILTER_BY_BACKEND_ROLES` to `AD_FILTER_BY_BACKEND_ROLES`
- `MAX_ENTITIES_PER_QUERY` to `AD_MAX_ENTITIES_PER_QUERY`
- `MAX_MODEL_SIZE_PER_NODE` to `AD_MAX_MODEL_SIZE_PER_NODE`
- `MAX_MULTI_ENTITY_ANOMALY_DETECTORS` to `AD_MAX_HC_ANOMALY_DETECTORS`
- `MAX_RETRY_FOR_END_RUN_EXCEPTION` to `AD_MAX_RETRY_FOR_END_RUN_EXCEPTION`
- `MAX_SINGLE_ENTITY_ANOMALY_DETECTORS` to `AD_MAX_SINGLE_ENTITY_ANOMALY_DETECTORS`
- `MODEL_MAX_SIZE_PERCENTAGE` to `AD_MODEL_MAX_SIZE_PERCENTAGE`
- `PAGE_SIZE` to `AD_PAGE_SIZE`
- `RESULT_WRITE_QUEUE_MAX_HEAP_PERCENT` to `AD_RESULT_WRITE_QUEUE_MAX_HEAP_PERCENT`
- **Class-level**:
- `ADRealtimeTaskCache` renamed to `RealtimeTaskCache`
- **Package-level**:
- Shifted from `org.opensearch.ad.breaker` to `org.opensearch.timeseries.breaker`
**Migrations**:
- Variables transferred from `AnomalyDetectorSettings` to `TimeSeriesSettings`:
- `BATCH_BOUNDING_BOX_CACHE_RATIO`
- `CHECKPOINT_MAINTAIN_REQUEST_SIZE_IN_BYTES`
- `CHECKPOINT_WRITE_QUEUE_SIZE_IN_BYTES`
- `DEFAULT_AD_JOB_LOC_DURATION_SECONDS` (renamed to `DEFAULT_JOB_LOC_DURATION_SECONDS`)
- `ENTITY_REQUEST_SIZE_IN_BYTES`
- `HOURLY_MAINTENANCE`
- `INTERVAL_RATIO_FOR_REQUESTS`
- `LOW_SEGMENT_PRUNE_RATIO`
- `MAINTENANCE_FREQ_CONSTANT`
- `MAX_COLD_START_ROUNDS`
- `MAX_QUEUED_TASKS_RATIO`
- `MAX_TOTAL_RCF_SERIALIZATION_BUFFERS`
- `MAX_CHECKPOINT_BYTES`
- `MEDIUM_SEGMENT_PRUNE_RATIO`
- `NUM_MIN_SAMPLES`
- `NUM_SAMPLES_PER_TREE`
- `NUM_TREES`
- `QUEUE_MAINTENANCE`
- `RESULT_WRITE_QUEUE_SIZE_IN_BYTES`
- `SERIALIZATION_BUFFER_BYTES`
- `THRESHOLD_MIN_PVALUE`
- `TIME_DECAY`
**Deletions**:
- Obsolete settings and methods:
- `DESIRED_MODEL_SIZE_PERCENTAGE` in `AnomalyDetectorSettings`
- `getDesiredModelSize` in `MemoryTracker`
**Modifications**:
- `MemoryTracker` enums renamed for clear differentiation between real-time and historical memory usage, adding `REAL_TIME_FORECASTER` for a harmonized single-stream and HC analysis approach.
**Tests**:
- Changes validated with a successful Gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 0c5b4b94cb5b192160463fa8a5f58eac587fe95d
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Aug 15 13:09:17 2023 -0700
Update RCF to v3.8 and Enable Auto AD with 'Alert Once' Option (#979)
* Update RCF to v3.8 and Enable Auto AD with 'Alert Once' Option
This PR added support for automatic Anomaly Detection (AD) and the 'Alert Once' option introduced in RCF 3.8.
Testing done:
1. Deserialization Test:
* Verified model deserialization from 3.0-rc3.
* Ensured consistent scoring using the rc3 checkpoint and rc3 dependency on identical data.
2. Backward Compatibility Test:
* Executed a mixed cluster with versions 2.10 and 3.0.
* Validated that older detectors still produce results without throwing any exceptions in a blue-green simulation scenario.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* reduce recall since alertOnce reduced recall
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* remove commented out code
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit cadc9bbd949daf4f2669335bfb8629e2137c108d
Author: Joshua Palis <jpalis@amazon.com>
Date: Fri Aug 11 16:02:38 2023 -0700
Fixing imports, adding TermsAggregator BucketCountThresholds for StringTerms, setting AnomalyResult grade to 0 if negative value (#976)
Signed-off-by: Joshua Palis <jpalis@amazon.com>
commit 3985cd2f82f2cfa57604ecf5a512bb042e632cae
Author: Romain Tartière <romain@blogreen.org>
Date: Wed Aug 9 08:59:30 2023 -1000
Fix build with latest OpenSearch (for real this time) (#972)
This is a follow-up to #971, where commit
2839bc2c6f470639b68901086c80cb2152d96558 only fixed _some_ but not _all_
of the build errors (it allowed `./gradlew run` to pass but `./gradlew
build` was failing).
Fix the build errors when we run `./gradlew build`.
Signed-off-by: Romain Tartière <romain@blogreen.org>
commit 2839bc2c6f470639b68901086c80cb2152d96558
Author: Romain Tartière <romain@blogreen.org>
Date: Tue Aug 8 13:15:04 2023 -1000
Fix build with latest OpenSearch (#971)
OpenSearch recently merged some code that cause buid failure for this
module, as spotted in #585.
This change the import to match the new one after
https://github.com/opensearch-project/OpenSearch/pull/9103
Signed-off-by: Romain Tartière <romain@blogreen.org>
commit d4946f04e7ad44f0bc79215962c6678786c592ff
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Aug 7 14:21:56 2023 -0700
Refactor ADTask and Related Components (#969)
* Refactor ADTask and Related Components
This PR includes several key refactoring changes:
- Extracts common code from ADTask into TimeSeriesTask, creating ForecastTask for forecasting-specific logic.
- Consolidates common code from ADTaskType into TaskType and introduces ForecastTaskType for forecasting-related purposes.
- Renames ADTaskState to TaskState for consistent code reuse.
- Renames the method getId in ADTask to getConfigId to differentiate it from other IDs like task id.
Testing done:
1. Added unit tests for the new code to ensure functionality.
2. Executed a successful Gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* add comments and address compiler errors
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Amit's comments and address compiler failure
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 1130a1ba6fc3c08f375dd99f98e93e4ee36331fb
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jul 27 10:39:39 2023 -0700
Refactoring NodeStateManager etc. to support forecasting functionality (#965)
* Refactoring NodeStateManager etc. to support forecasting functionality
This commit extends the codebase to support both Anomaly Detection (AD) and forecasting. It contains a mixture of refactoring, renaming, removal of unused code, and package moving tasks. Here are the details:
Refactoring:
- `NodeStateManager.getAnomalyDetector` is now `getConfig`, with added functionality to fetch a Forecaster. The method comments are updated for clarity.
- Existing methods (`getFeatureSamplesForPeriods`, `getColdStartSamplesForPeriods`, `createPreviewSearchRequest`, `getMinDataTime`) have been added in `SearchFeatureDao` to handle forecasting logic.
- Adjusted `SecurityClientUtil` and `ParseUtils` to handle forecasting logic.
- Cleaned up `NodeState` to differentiate state for AD and forecasting.
Renaming:
- `AnomalyDetectorJob` is renamed to `Job` to facilitate reuse for forecasting.
- `NodeStateManager.getAnomalyDetectorJob` is renamed to `getJob`.
- Certain settings in `AnomalyDetectorSettings` are renamed to reflect they are meant for the AD setting. They have been marked as deprecated and new settings are used in `TimeSeriesSettings` instead.
- `IndexAnomalyDetectorJobActionHandler.getAnomalyDetectorJobForWrite` is renamed to `getJobForWrite`.
- `ADSafeSecurityInjector` is renamed to `TimeSeriesSafeSecurityInjector`.
Removing unused code:
- Synchronous code in `ClientUtil`, `IndexUtils`, and `CheckpointDao` is removed.
- The unused class `Throttler` is deleted.
- Mapping file names are changed, and the code referencing these files is adjusted.
Package moving:
- Several classes (`ClientUtil`, `MultiResponsesDelegateActionListener`, `SafeSecurityInjector`, `SecurityUtil`, `ExceptionUtil`, `SearchFeatureDao`, `CleanState`, `ExpiringState`, `MaintenanceState`, `NodeState`, `SingleStreamModelIdMapper`, `BackPressureRouting`) are moved to the respective `org.opensearch.timeseries` packages.
Miscellaneous:
- Fixed compiler failures caused by changes in https://github.com/opensearch-project/OpenSearch/pull/8730 by replacing `DoubleArrayList` with `java.util.ArrayList`.
- Updates the Backwards Compatibility (bwc) version to align with the core's incremented bwc version as per [OpenSearch PR #8670](https://github.com/opensearch-project/OpenSearch/pull/8670). This change prevents the issue described in [OpenSearch Issue #5076](https://github.com/opensearch-project/OpenSearch/issues/5076).
Testing:
- Executed a `gradle build`.
- Added new tests for `ClientUtil` and `NodeStateManager`.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comment
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* fix compiler error and comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit f0ed43b1aa3c5d80dc6f23a5dd4465bb03ef1739
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jul 17 15:18:03 2023 -0700
Rename AD to time series analytics & Resolve Compiler Errors (#951)
This commit focuses on renaming the AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin as well as addressing compiler errors due to package import changes. The primary transformations are:
* Renamed AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin.
* Updated all references from AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin.
* Amended plugin information in build.gradle and src/main/resources/es-plugin.properties.
* Switched job type in TimeSeriesAnalyticsPlugin from opendistro_anomaly_detector to opensearch_time_series_analytics.
These changes led to the modification of our plugin binary from opensearch-anomaly-detection-3.0.0.0-SNAPSHOT.jar to opensearch-time-series-analytics-3.0.0.0-SNAPSHOT.jar.
Moreover, following changes from OpenSearch Pull Request #8157, compiler errors were encountered, which were resolved by updating the import packages
* org.opensearch.common.io.stream.NamedWriteableRegistry => org.opensearch.core.common.io.stream.NamedWriteableRegistry
* org.opensearch.common.xcontent.XContentParserUtils => * org.opensearch.core.xcontent.XContentParserUtils
* org.opensearch.common.bytes.BytesArray => org.opensearch.core.common.bytes.BytesArray * org.opensearch.common.io.stream.StreamInput => * org.opensearch.core.common.io.stream.StreamInput ** org.opensearch.common.io.stream.StreamOutput => org.opensearch.core.common.io.stream.StreamOutput
* org.opensearch.common.io.stream.Writeable => org.opensearch.core.common.io.stream.Writeable
* org.opensearch.common.io.stream.NotSerializableExceptionWrapper => org.opensearch.core.common.io.stream.NotSerializableExceptionWrapper
* org.opensearch.rest.RestStatus => org.opensearch.core.rest.RestStatus
* org.opensearch.common.ParsingException => org.opensearch.core.common.ParsingException
* org.opensearch.common.bytes.BytesReference => org.opensearch.core.common.bytes.BytesReference
* org.opensearch.common.io.stream.InputStreamStreamInput => org.opensearch.core.common.io.stream.InputStreamStreamInput
* org.opensearch.common.io.stream.OutputStreamStreamOutput => org.opensearch.core.common.io.stream.OutputStreamStreamOutput
* org.opensearch.index.shard.ShardId => org.opensearch.core.index.shard.ShardId* org.opensearch.index.Index => org.opensearch.core.index.Index
* org.opensearch.core.index.IndexNotFoundException => org.opensearch.index.IndexNotFoundException
Validation steps were executed to ensure these changes did not break functionality:
* gradle build was successful. A local build was required due to outdated OpenSearch and job scheduler nightly builds.
* Backward compatibility tests were performed on a two-node 2.9 cluster running some detectors. These detectors continued to produce results on a 3.0 cluster with these updates.
* I can start new detectors on the 3.0 node.
* After shutting down a 2.9 node, the job transfer to the 3.0 node was successful and the job continued to perform as expected.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit c7c6a46e88e15f615fc9dae0499cf0d674662057
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Thu Jul 13 15:42:46 2023 -0700
Add 2.9 release notes (#952)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit bc1649922ef39619424fc16c64af5836e48a4a12
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Jul 11 13:34:09 2023 -0700
Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards (#948)
* Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards
In this PR, we temporarily enforce DOCUMENT replication for AD indices. This change is necessary due to the current limitation of SegRep, which doesn't support Get/MultiGet by ID. This measure will be in place until SegRep adds support for these operations.
This adjustment aligns with the modification made in the referenced PR: job-scheduler PR #417
Additionally, this PR increases the number of primary shards for forecasting indices from 10 to 20, recognizing the higher write intensity of these indices. For instance, when the horizon is 24, we are expected to save 25 documents: 24 for each forecast and 1 for the actual value. In contrast, for AD, we save one document per actual value.
Testing done:
1. gradle build passed
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Fix comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit a1203827617ee42b35d41cb8b010719f334f73b7
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jul 10 10:53:17 2023 -0700
Add ForecastResult and Refactor Shared Code (#941)
This commit adds the functionality of ForecastResult, while also performing several necessary refactorings.
Firstly, we introduce ForecastResult, which closely mirrors the functionality of AnomalyResult. Any shared code between these two classes has been abstracted out into a new parent class, IndexableResult. This refactoring was undertaken to facilitate code reuse and improve maintainability, as both classes deal with storing fields that need to be saved in result indices.
Secondly, we've also extracted common code from ThresholdingResult into another new class, IntermediateResult. This work is in preparation for a forthcoming PR which will introduce RCFCasterResult. In this change, we moved the 'toAnomalyResult' method to IndexableResult, and renamed it to 'toIndexableResults'. This renaming allows for reuse in the upcoming RCFCasterResult. The updated method now returns a list of results instead of a single result. The shift caters for the RCFCasterResult use case where one RCFCasterResult is stored across multiple ForecastResult documents.
Furthermore, this commit modifies the 'entity' field in several methods to be of the Optional type, indicating that it can be empty. This change provides a clear signal to other developers about the optional nature of these fields.
In addition, this commit updates the mapping for the forecast result index. The prior mapping was a placeholder and this change brings it up to date.
We've also moved to using httpcore5 and httpclient5 versions from OpenSearch core, as necessitated by recent changes in [OpenSearch PR #8434](https://github.com/opensearch-project/OpenSearch/pull/8434/files). This shift resolves potential jar hell issues with httpcore5 and httpclient5.
Lastly, we've made name and package changes:
1. Renamed 'initDetectionStateIndex' in ADIndexManagement to 'initStateIndex' to align with ForecastIndexManagement naming.
2. Moved the 'DataByFeatureId' class to the 'timeseries' package for better organization.
This commit also completes the 'createDummyIndexRequest' method in ForecastIndexManagement by invoking 'ForecastResult.getDummyResult()', which is now possible due to the introduction of the ForecastResult implementation.
Testing done:
1. added tests for new code
2. gralde build passes
3. e2e tests
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit f24d9e32ff739abf29cac3da15fd00f74219e213
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Thu Jul 6 17:28:09 2023 -0700
Bump scipy from 1.8.0 to 1.10.0 in /dataGeneration (#943)
Bumps [scipy](https://github.com/scipy/scipy) from 1.8.0 to 1.10.0.
- [Release notes](https://github.com/scipy/scipy/releases)
- [Commits](https://github.com/scipy/scipy/compare/v1.8.0...v1.10.0)
---
updated-dependencies:
- dependency-name: scipy
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 9b9fd2ba3f3e678d717c0a45af8069bb67828808
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Jun 27 16:08:55 2023 -0700
bump guava version to 32.0.1 (#933)
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit 99749dfa6bfc8a2f2c4660ca01d75d1ad57124a5
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jun 26 16:46:24 2023 -0700
Refactoring Index Creation for Improved Code Reuse and Consistency (#932)
This Pull Request significantly refactors the index creation module to promote greater code reusability and consistency. The primary changes are outlined as follows:
1. Code Migration: Common code segments have been moved from AnomalyDetectionIndices to IndexManagement. In addition, component-specific code has been established in ADIndexManagement and ForecastIndexManagement. The bulk of changes are concentrated in these three classes, with the remainder of the modifications relating to reference/test changes.
2. Function Renaming: Several functions have been renamed for broader applicability and consistency:
* AnomalyDetectorFunction has been renamed to ExecutorFunction for potential use in Forecasting.
* AnomalyDetectorSettings.MAX_PRIMARY_SHARDS has been renamed to AnomalyDetectorSettings.AD_MAX_PRIMARY_SHARDS in light of the new ForecastSettings.FORECAST_MAX_PRIMARY_SHARDS.
* doesAnomalyDetectorJobIndexExist() has been renamed to doesJobIndexExist() to allow for job index reusability across Anomaly Detection (AD) and forecasting. Analogous changes have been made to other job index-related functions.
* doesAnomalyDetectorIndexExist() has been renamed to doesConfigIndexExist() to allow for config index reusability across AD and forecasting. Analogous changes have been made to other config index-related functions.
* detectionIndices.doesDetectorStateIndexExist() has been renamed to detectionIndices.doesStateIndexExist(), as the former name was unnecessarily redundant. Similar modifications have been made to the result and checkpoint index.
3. Class Migration: The classes ThrowingSupplierWrapper, ThrowingConsumer, and ThrowingSupplier have been moved from org.opensearch.ad.util to org.opensearch.timeseries.function to promote code reuse.
4. Initial Forecast Indices' Mapping: An initial version of forecast indices' mapping has been added, which can be adjusted as required in the future.
5. In terms of version updates, 2.x has been bumped to 2.9, prompting an increment of the Backward Compatibility (BWC) test version to 2.9.
6. Update dependency com.google.guava:guava to v32 for cve fix.
Testing done:
Testing has been performed with new tests added for forecast index creation, and the grade build passes successfully.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit aedb781a6b1df984636d72d50b65d41138539918
Author: Craig Perkins <craig5008@gmail.com>
Date: Tue Jun 20 16:55:19 2023 -0400
Fix main build - update import of Releasable and remove reference to BaseExceptionsHelper (#930)
* Fix main build - update import of Releasable and remove reference to BaseExceptionsHelper
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update imports in test classes
Signed-off-by: Craig Perkins <cwperx@amazon.com>
---------
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit fce78c29c0375ae06f56e16c85fb98933401e28f
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Jun 14 10:36:40 2023 -0700
Refactor: Reorganize code for Forecasting and AnomalyDetector packages (#925)
* Refactor: Reorganize code for Forecasting and AnomalyDetector packages
This PR includes several refactorings to increase code reuse and improve readability:
1. Entity, FeatureData, and RestHandlerUtils have been moved from the 'ad' package to the 'timeseries' package, enabling their use within the Forecasting code.
2. A new class, DataByFeatureId, has been created to hold shared code previously located in FeatureData. FeatureData now inherits from DataByFeatureId. The standalone usage of DataByFeatureId will be detailed in subsequent PRs.
3. Renamed checkAnomalyDetectorFeaturesSyntax to checkFeaturesSyntax in RestHandlerUtils to make it more generic and usable for Forecasting.
4. Constants AGG_NAME_MAX_TIME, AGG_NAME_MIN_TIME, DATE_HISTOGRAM, and FEATURE_AGGS have been moved from ADCommonName to CommonName to make them accessible for Forecasting.
5. A new method, parseConfig, has been added to the Config class. This method can parse configuration for either AnomalyDetector or Forecaster based on input.
Testing:
The changes have been validated with a successful gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Amit and Owais's comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 02c120f025f73f3d45a8477c7ef8b4873befebfa
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jun 12 11:54:39 2023 -0700
Updated Maintainers and CODE_OWNERS list (#926)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 2ea4dcf430b40a710a0babb04881eeff9fb2d689
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jun 8 15:11:44 2023 -0700
Add Forecaster class (#920)
* Add Forecaster class
This PR adds class Forecaster that serves as the configuration POJO for forecasting. Shared code between AnomalyDetector and Forecaster is extracted and moved to the Config class to reduce duplication and promote reusability. References to the common code in related classes have also been adjusted.
Testing done:
1. gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* fix compiler error due to a recent core change
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Sudipto and Amit's comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit ee04225349a5f0f003d56e77a3243386f4a9673d
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri Jun 2 15:42:19 2023 -0700
Refactor: Migrate files from 'ad' to 'timeseries' package (#918)
* Refactor: Migrate files from 'ad' to 'timeseries' package
This commit involves moving various files from the 'ad' package to the 'timeseries' package. All changes to dependent imports were handled automatically through the IDE, and no changes to file contents were made in the process.
Testing done:
- gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* move ParseUtils to util package
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 472868d165c2234eece8827584f64086aaf7ae92
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jun 1 11:17:16 2023 -0700
Refactor Shared Settings, Introduce Dynamic Forecast Settings, Rename (#912)
* Refactor Shared Settings, Introduce Dynamic Forecast Settings, and Rename Checkpoint mapping File
This commit has undertaken three changes:
* Refactoring of Shared Settings: I've performed a refactoring to unify the settings that are shared between the AD and forecasting modules.
* Introduction of Dynamic Forecast Settings: To increase the adaptability of our system, I've implemented dynamic forecast settings. These settings mirror the existing structure of the AD dynamic settings and will enable us to adjust forecast settings on-the-fly.
* Renaming of Checkpoint File: To enhance the consistency across our AD mapping files, I've renamed checkpoint.json to anomaly-checkpoint.java.
Testing done:
1. added tests for new settings.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* name change and delete files
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 04ab91e60e9d71765a7b9df10b86e0e53ba4d715
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 31 12:18:54 2023 -0700
add 2.8 release notes (#915)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 98da8dffe8d336793ae35658015650b0f83aeef1
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 24 14:37:38 2023 -0700
Implementing Multiple Imputation Methods for Missing Values (#907)
* Implementing Multiple Imputation Methods for Missing Values
This Pull Request introduces multiple imputation methods to handle missing data in Anomaly Detection (AD) and forecasting. The ability to handle missing data is crucial to improve the robustness and accuracy of our models.
The following imputation methods have been implemented:
* Zero Imputation (ZERO): This method replaces all missing values with 0's. It's a simple approach, but it may introduce bias if the data is not centered around zero.
* Fixed Values Imputation (FIXED_VALUES): This method replaces missing values with a predefined set of values. The values are the same for each input dimension, and they need to be specified by the user.
* Previous Value Imputation (PREVIOUS): This method replaces missing values with the last known value in the respective input dimension. It's a commonly used method for time series data, where temporal continuity is expected.
* Linear Interpolation (LINEAR): This method estimates missing values by interpolating linearly between known values in the respective input dimension. This method assumes that the data follows a linear trend.
These methods are designed to provide a set of options for users to handle missing data based on their specific needs and the nature of their data.
Testing Done:
The code changes in this pull request have been validated through a gradle build to ensure that all new and existing tests pass successfully.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Various changes
The commit makes all new files use the shortened header text and addresses compiler/test issues due to core refactoring
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit da608aaa3d3f955efe32b0cb33b3c8cfdd7a7718
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue May 16 11:37:34 2023 -0700
Code Refactoring for CommonMessages (#902)
* Code Refactoring for CommonMessages
In this pull request, I have refactored the code related to shared log or error messages in both AD and forecasting modules to CommonMessages. Additionally, the previously used CommonErrorMessages has been renamed to ADCommonMessages. For the Forecasting module, I have introduced new names in ForecastCommonMessages.
Testing done:
* gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Update string constants wording
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve wording and remove redundant variables
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 041d6ce73d37f1697013b2d2f0683fbfe012247c
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri May 12 13:05:56 2023 -0700
Code Refactoring for CommonName (#901)
In this pull request, I have refactored the code related to shared names in both AD and forecasting modules to CommonNames. Additionally, the previously used CommonName has been renamed to ADCommonName. For the Forecasting module, I have introduced new names in ForecastCommonNames.
Testing done:
* gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit e2fee9d6ba59cc2a23eadbb50a80414fcc7dbf8f
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 10 17:26:31 2023 -0700
Update outdated MAINTAINERS and OWNERS list (#898)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 98b566d1ec57ffd8970b5180c54b493deb1a24ac
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Wed May 10 18:03:04 2023 -0400
Sync up CODEOWNERS with MAINTAINERS.md. (#897)
Signed-off-by: dblock <dblock@amazon.com>
commit 1f8415aa39fa4ec3ba016214255aa0e79b7c7d63
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue May 9 12:55:35 2023 -0700
Various fixes (#886)
* Various fixes
This pull request addresses several issues related to the compiler and tests in the current main branch.
The first major change involves replacing ImmutableOpenMap with java.util.Map in the core. This modification is implemented in the following pull requests:
https://github.com/opensearch-project/OpenSearch/pull/7165
https://github.com/opensearch-project/OpenSearch/pull/7301
To accommodate this change, the codebase of the AD (Anomaly Detection) module has been refactored to utilize JDK maps. As a consequence of this change, passing null to the custom parameters of ClusterState is no longer permissible, as it leads to a NullPointerException. The error stack trace is as follows:
java.lang.NullPointerException: Cannot invoke "Object.getClass()" because "m" is null
at __randomizedtesting.SeedInfo.seed([60CDDB34427ACD0C:6E72DB4ED18E018D]:0)
at java.base/java.util.Collections.unmodifiableMap(Collections.java:1476)
at org.opensearch.cluster.ClusterState.<init>(ClusterState.java:219)
at org.opensearch.ad.transport.DeleteAnomalyDetectorTests.createClusterState(DeleteAnomalyDetectorTests.java:216)
at org.opensearch.ad.transport.DeleteAnomalyDetectorTests.testDeleteADTransportAction_LatestDetectorLevelTask(DeleteAnomalyDetectorTests.java:160)
To address this issue, we have replaced the usage of null with new HashMap<>().
The second change in this pull request aligns with the modifications introduced in PR https://github.com/opensearch-project/anomaly-detection/pull/878.
The third issue is related to the incompatibility between tests that utilize the @Parameters annotation and those that do not, as explained in https://tinyurl.com/2y265s2w. Specifically, the SearchFeatureDaoTests class runes tests with the @Parameters annotation, whereas SearchFeatureDao tests do not.
Testing done:
1. gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 0a48da9e1a0cd70c64cc2da228674baaf377c89e
Author: Jackie Han <hnyng@amazon.com>
Date: Mon Apr 17 12:44:06 2023 -0700
Add 2.7 release notes (#871)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 1edc2ef1ccfe20938711984744b20d1f2ec96a3c
Author: Jackie Han <hnyng@amazon.com>
Date: Tue Apr 11 17:53:57 2023 -0700
Update OpenSearchRejectedExecutionException import (#861)
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update NodeInfo constructor and javadoc for isAdmin method
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit b8df172c2364997c446096e960068d6fc5d2e6f6
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Apr 11 10:55:28 2023 -0700
Giving admin priority over backendrole filtering (#850)
* giving admin priority over backend role filtering
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
* fix security tests
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
* remove redundent line in test case
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
---------
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit fd2fd5d5f63c9004b9f265e3c1e4475282447da8
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Thu Mar 16 14:30:32 2023 -0400
Created untriaged issue workflow. (#809)
Signed-off-by: dblock <dblock@amazon.com>
commit fd547014fdde5114bbc9c8e49fe7aaa37eb6e793
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Mar 1 16:41:05 2023 -0800
Publish snapshots to maven via GHA, fix spotless errors, and bump bwc version (#827)
We are de-coupling the task of publishing the maven snapshots from centralized build workflow to individual repositories. This PR publishes maven snapshots using GitHub Actions.
Testing done:
1. ran ./gradlew publishPluginZipPublicationToSnapshotsRepository according to https://github.com/opensearch-project/anomaly-detection/issues/813
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit b6be5960fb8cff41f0e9d13d5f5a971c289b80ed
Author: Jackie Han <hnyng@amazon.com>
Date: Thu Feb 23 12:23:01 2023 -0800
Update xcontent imports (#822)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 1dcb78a6c4d1331133aefe5af7adf137daa8846f
Author: Jackie Han <hnyng@amazon.com>
Date: Wed Feb 22 11:17:21 2023 -0800
Add 2.6 release note (#818)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 553688aae45590c37cc4d86102642d0b3a6ebb33
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Feb 9 13:38:14 2023 -0800
Revert changes to exception message (#803)
* Revert changes to exception message
We used to log "No RCF models are available either because RCF models are not ready..." and now we log "resource_not_found_exception: No checkpoints found for model id...". This change caused an integration test failure. This PR reverts it back.
Testing done:
1. verified that the original log is back.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* check NO_MODEL_ERR_MSG instead of NO_CHECKPOINT_ERR_MSG
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit c9bdc628a03c4ced3cd1ebeec44ebff792d7ff98
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri Feb 3 11:15:37 2023 -0800
fixing dls/fls logic around numeric aggregations (#801)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 9cebc5bc97a84dd78ac8892863ff7d674428bced
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Jan 10 02:17:04 2023 +0000
adding 2.5 release notes
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit 2ace84643fd199a5e5179e6d21ab76ae212cb7d8
Author: Ryan Bogan <10944539+ryanbogan@users.noreply.github.com>
Date: Tue Jan 10 13:31:49 2023 -0800
Add jackson back to build.gradle (#780)
Signed-off-by: Ryan Bogan <rbogan@amazon.com>
commit a5d60eefab5ac30ef5243da8e7a88b7a2189cd5c
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jan 9 15:49:35 2023 -0800
bump bwc to 2.6.0 (#775)
We need to bump the version because only the latest 2.x will be upgradable to 3.0 when that ship. Since OpenSearch core bumped to 2.6, we need to do that as well. Note after bumping version, bwc still fails to find 2.6.0 core zip.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 27ed49863bfbef90551cdfacc6b51703bf622e25
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jan 9 12:17:57 2023 -0800
Fix the discrepancy between Profile API and real time tasks API (#770)
* Fix the discrepancy between Profile API and real time tasks API
This PR fixes the discrepancy by querying the result index when the total updates is less than 32. We have done similar things in profile API so I refactored reusable code to ProfileUtil. We also cached whether we have queried the result index and won't repeatedly issue the extra query.
Testing done:
1. repeated repro steps in https://github.com/opensearch-project/anomaly-detection/issues/502 and verified the issue has been resolved.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit b49a36b3e7962a205695d451e0497ee4f57fb2cb
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Thu Jan 5 10:19:51 2023 -0800
Updated MAINTAINERS.md to match recommended opensearch-project format. (#771)
Signed-off-by: dblock <dblock@amazon.com>
commit 20d2c5f94811f62a7077142ba505bed272a83549
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Dec 20 13:16:21 2022 -0800
update bwc to 2.5 (#765)
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit e08314f43a22d2692e8467efae3699fce0440611
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Dec 20 11:00:45 2022 -0800
[Forward-Port to main] Fix _source bug (#749) (#764)
* Fix _source bug (#749)
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
* fixed strings method
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit 134942ed61b984e57b1f9c6bc7d416232d8f59d2
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri Dec 16 09:38:46 2022 -0800
Speed up cold start (#753)
* Speed up cold start
If historical data is enough, a single stream detector takes 1 interval for cold start to be triggered + 1 interval for the state document to be updated. Similar to single stream detectors, HCAD cold start needs 2 intervals and one more interval to make sure an entity appears more than once. So HCAD needs three intervals to complete cold starts. Long initialization is the single most complained problem of AD. This PR reduces both single stream and HCAD detectors' initialization time to 1 minute by
* delaying real time cache update by one minute when we receive ResourceNotFoundException in single stream detectors or when the init progress of HCAD real time cache is 0. Thus, we can finish the cold start and writing checkpoint one minute later and update the state document accordingly. This optimization saves one interval to wait for the state document update.
* disable the door keeper by default so that we won't have to wait an extra interval in HCAD.
* trigger cold start when starting a real time detector. This optimization saves one interval to wait for the cold start to be triggered.
Testing done:
* verified the cold start time is reduced to 1 minute.
* added tests for new code.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 609abe42df8af450e48bfa122746361f7a8201c7
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Thu Dec 15 17:11:10 2022 -0500
Fix: typo in ohltyler. (#760)
Signed-off-by: dblock <dblock@amazon.com>
commit ce3d747317aec5ccef080c767d4ba8e7015c5a2a
Author: Varun Jain <varunudr@amazon.com>
Date: Tue Dec 6 15:44:33 2022 -0800
Model Profile Test (#748)
commit 09b4cc1ac3ab9fb4e589754acba619d265603580
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Mon Dec 5 12:06:16 2022 -0800
Use sonatype to fetch JS instead of ci.opensearch.org (#740)
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit a3e2b994ed347263a8dbaf5beed6bd5ddd6931a4
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Nov 30…
kaituo
added a commit
to kaituo/anomaly-detection-1
that referenced
this pull request
Mar 27, 2024
commit 30347847cb4ec87f7318587d97054d91c341a312
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Mar 26 13:40:53 2024 -0700
Upgrade rcf to 4.0 (#1173)
This PR upgrades rcf to 4.0 as it has bug fixes and support for streaming imputation mode.
Testing done:
1. gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 8ca1d0d837dd28b6e0820756136eafb8c3ce03ad
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Mar 25 13:44:45 2024 -0700
dependabot: bump actions/checkout from 3 to 4 (#1098)
Bumps [actions/checkout](https://github.com/actions/checkout) from 3 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v3...v4)
---
updated-dependencies:
- dependency-name: actions/checkout
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit d0a2a8ff9fd9640000763c433e05577eea292c48
Author: Darshit Chanpura <35282393+DarshitChanpura@users.noreply.github.com>
Date: Mon Mar 25 16:44:36 2024 -0400
Updates sample cert and admin keystore (#1163)
Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
commit 1921e12b30ac442cd731a5d7a3bdfd3bc31be82b
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Mar 25 13:14:52 2024 -0700
Bump urllib3 from 1.26.17 to 1.26.18 in /dataGeneration (#1090)
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.17 to 1.26.18.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.17...1.26.18)
---
updated-dependencies:
- dependency-name: urllib3
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 8521a76533b533d6887321505c7b5e3d473b02ae
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Mar 25 13:14:18 2024 -0700
dependabot: bump org.apache.commons:commons-pool2 from 2.11.1 to 2.12.0 (#1088)
Bumps org.apache.commons:commons-pool2 from 2.11.1 to 2.12.0.
---
updated-dependencies:
- dependency-name: org.apache.commons:commons-pool2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 303ceb5b320f148dcd015ab6a11f870ae3e23125
Author: Joshua Palis <jpalis@amazon.com>
Date: Mon Mar 18 16:49:59 2024 -0700
Adding 2.13 release notes (#1170)
Signed-off-by: Joshua Palis <jpalis@amazon.com>
commit 1507dd4b4045bd8e8cdf505d07041ce304788ca0
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Feb 21 15:59:34 2024 -0800
Inject NamedWriteableRegistry in AD node client (#1164)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 5b85720d442d1b43001dde0c20248fd4a20a64b0
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Tue Feb 13 10:20:20 2024 -0800
Fixed lucene url (#1158)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 290bdcd832a0cae6d039787d9f0af73ea6be2ec2
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Feb 6 16:14:49 2024 -0800
add 2.12 release notes (#1152)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 6a6eec347379c997f0f7acc88b027bc1ffdd8f54
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Tue Jan 30 18:20:36 2024 -0800
Add ser/deser to get AD transport action request (#1150)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 475f0c36e5b6267aaeb101627b9c3ae1fcca3a88
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Thu Jan 25 14:37:12 2024 -0800
Updated lucene snapshot url (#1146)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 7192d848d2923566a409901909f342a63695e1c2
Author: Jackie Han <hnyng@amazon.com>
Date: Thu Jan 25 09:48:37 2024 -0800
Remove default admin credentials (#1134)
* Remove default admin credentials
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Replace default password with a placeholder in README files
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 97482c19b0eded34a7f435e589303a834c258aa3
Author: Jackie Han <hnyng@amazon.com>
Date: Wed Jan 24 09:39:55 2024 -0800
Require JDK version for java spotless check (#1129)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 708e0462189677a217b35905c2feba5486c77cdc
Author: Andriy Redko <andriy.redko@aiven.io>
Date: Tue Jan 23 15:11:39 2024 -0500
Update to Jackson 2.16.1 (#1135)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
commit 7c0ce4cb554a05230ecf5365b903219f357997bf
Author: Andriy Redko <drreta@gmail.com>
Date: Tue Jan 16 17:51:37 2024 -0500
Update to Gradle 8.5 (#1131)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
commit e5cbe93c0e9cadebe2a30cba83f99ae8a3f8fe57
Author: zane-neo <zaniu@amazon.com>
Date: Thu Jan 4 16:50:47 2024 +0800
add publishToMavenLocal task to fix zip plugin not pulished to maven local issue when running this script (#1121)
Signed-off-by: zane-neo <zaniu@amazon.com>
commit 106dc25b3ef36beae329dc7882bcdf9c23347fb5
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Dec 27 16:33:25 2023 -0800
Refactor client's getDetectorProfile to use GetAnomalyDetectorTransportAction (#1124)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 59b4ebecfa11cac977f49c999ce85637fb6fac58
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Wed Dec 27 11:56:00 2023 -0800
Add profile transport action to AD client (#1119)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 29711f96dbb2c9abc1181b933a8b334eed63ca66
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Tue Dec 12 08:32:53 2023 -0800
Add an AD transport client (#1110)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit 353dcaeb05f8b75fa74d92e2ae8415ab018bc68e
Author: Daniel Widdis <widdis@gmail.com>
Date: Wed Nov 22 13:59:53 2023 -0800
Fix build, update CVE-affected versions (#1102)
* Fix build, update CVE-affected versions
Signed-off-by: Daniel Widdis <widdis@gmail.com>
* Spotless depends on CVE-impacted eclipse dependency, now needs JDK17+
Signed-off-by: Daniel Widdis <widdis@gmail.com>
---------
Signed-off-by: Daniel Widdis <widdis@gmail.com>
commit 4c6ba48bf9fb9234ad8bc0b9193f3c68409acfb9
Author: Peter Zhu <zhujiaxi@amazon.com>
Date: Mon Oct 30 19:35:01 2023 -0400
Fix the bwc test version retrieval (#1093)
* Onboarding jenkins prod docker images to github actions
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
---------
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
commit a1da3aa0eefc6671446d2eb3bc670bad6449d2f0
Author: Peter Zhu <zhujiaxi@amazon.com>
Date: Mon Oct 30 19:14:31 2023 -0400
Onboarding jenkins prod docker images to github actions (#1092)
* Onboarding jenkins prod docker images to github actions
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add temurin
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
* Add more
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
---------
Signed-off-by: Peter Zhu <zhujiaxi@amazon.com>
commit 040cd7e33f8e696ffe7748140c9b0ecc7475d513
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:43:02 2023 -0700
dependabot: bump net.bytebuddy:byte-buddy from 1.14.6 to 1.14.9 (#1081)
Bumps [net.bytebuddy:byte-buddy](https://github.com/raphw/byte-buddy) from 1.14.6 to 1.14.9.
- [Release notes](https://github.com/raphw/byte-buddy/releases)
- [Changelog](https://github.com/raphw/byte-buddy/blob/master/release-notes.md)
- [Commits](https://github.com/raphw/byte-buddy/compare/byte-buddy-1.14.6...byte-buddy-1.14.9)
---
updated-dependencies:
- dependency-name: net.bytebuddy:byte-buddy
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit dd9c1521bc1946027245d65e39a7844cdf04a8b7
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:42:15 2023 -0700
dependabot: bump aws-actions/configure-aws-credentials (#1076)
Bumps [aws-actions/configure-aws-credentials](https://github.com/aws-actions/configure-aws-credentials) from 1.7.0 to 4.0.1.
- [Release notes](https://github.com/aws-actions/configure-aws-credentials/releases)
- [Changelog](https://github.com/aws-actions/configure-aws-credentials/blob/main/CHANGELOG.md)
- [Commits](https://github.com/aws-actions/configure-aws-credentials/compare/v1.7.0...v4.0.1)
---
updated-dependencies:
- dependency-name: aws-actions/configure-aws-credentials
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit d6e3fd7a69b1daea45d7a455335e55b6de118033
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:05:00 2023 -0700
dependabot: bump com.netflix.nebula.ospackage from 11.0.0 to 11.5.0 (#1066)
Bumps com.netflix.nebula.ospackage from 11.0.0 to 11.5.0.
---
updated-dependencies:
- dependency-name: com.netflix.nebula.ospackage
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 57eacf611ce44559e14aa37f2e51dfbb82d53cc2
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:04:19 2023 -0700
dependabot: bump org.apiguardian:apiguardian-api from 1.1.0 to 1.1.2 (#1058)
Bumps [org.apiguardian:apiguardian-api](https://github.com/apiguardian-team/apiguardian) from 1.1.0 to 1.1.2.
- [Release notes](https://github.com/apiguardian-team/apiguardian/releases)
- [Commits](https://github.com/apiguardian-team/apiguardian/compare/r1.1.0...r1.1.2)
---
updated-dependencies:
- dependency-name: org.apiguardian:apiguardian-api
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 6b9faf2b71e5481be366b12bd6f16440c6c8ef89
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:04:01 2023 -0700
dependabot: bump org.junit.platform:junit-platform-launcher (#1056)
Bumps [org.junit.platform:junit-platform-launcher](https://github.com/junit-team/junit5) from 1.9.2 to 1.10.0.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/commits)
---
updated-dependencies:
- dependency-name: org.junit.platform:junit-platform-launcher
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 2a957f2086688b5ee76703406105797d31207cc5
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 12:03:11 2023 -0700
Bump urllib3 from 1.26.9 to 1.26.17 in /dataGeneration (#1068)
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.9 to 1.26.17.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.9...1.26.17)
---
updated-dependencies:
- dependency-name: urllib3
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit a12e33214f9c138946975801cefa2bd39c7978a9
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 11:29:37 2023 -0700
dependabot: bump org.objenesis:objenesis from 3.0.1 to 3.3 (#1040)
Bumps [org.objenesis:objenesis](https://github.com/easymock/objenesis) from 3.0.1 to 3.3.
- [Release notes](https://github.com/easymock/objenesis/releases)
- [Commits](https://github.com/easymock/objenesis/compare/3.0.1...3.3)
---
updated-dependencies:
- dependency-name: org.objenesis:objenesis
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 5a4ba14a431fbc53f757416542cda25ef2fae58c
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Tue Oct 10 11:28:46 2023 -0700
dependabot: bump tibdex/github-app-token from 2.0.0 to 2.1.0 (#1065)
Bumps [tibdex/github-app-token](https://github.com/tibdex/github-app-token) from 2.0.0 to 2.1.0.
- [Release notes](https://github.com/tibdex/github-app-token/releases)
- [Commits](https://github.com/tibdex/github-app-token/compare/v2.0.0...v2.1.0)
---
updated-dependencies:
- dependency-name: tibdex/github-app-token
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 713d556d980ccb144eb6ae952cebc7b3963ed28c
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 15:05:44 2023 -0700
dependabot: bump actions/setup-java from 1 to 3 (#1035)
Bumps [actions/setup-java](https://github.com/actions/setup-java) from 1 to 3.
- [Release notes](https://github.com/actions/setup-java/releases)
- [Commits](https://github.com/actions/setup-java/compare/v1...v3)
---
updated-dependencies:
- dependency-name: actions/setup-java
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 574ac521653ede84e7b821bc3c06049f1054a6ad
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 10:53:02 2023 -0700
dependabot: bump tibdex/github-app-token from 1.5.0 to 2.0.0 (#1042)
Bumps [tibdex/github-app-token](https://github.com/tibdex/github-app-token) from 1.5.0 to 2.0.0.
- [Release notes](https://github.com/tibdex/github-app-token/releases)
- [Commits](https://github.com/tibdex/github-app-token/compare/v1.5.0...v2.0.0)
---
updated-dependencies:
- dependency-name: tibdex/github-app-token
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 65e207aef49a6872408ae02e4f49cdd9060c1ef0
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Wed Sep 13 10:52:40 2023 -0700
dependabot: bump org.apache.commons:commons-pool2 from 2.10.0 to 2.11.1 (#1045)
Bumps org.apache.commons:commons-pool2 from 2.10.0 to 2.11.1.
---
updated-dependencies:
- dependency-name: org.apache.commons:commons-pool2
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit a4ff71926af39726d9b4584102706e3ea7f4fa05
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:16:31 2023 -0400
React to Tracer changes in TransportService (#1034)
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 05d0a3b905cae9d25f6d5d91f30f1b842b9a792f
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:14:20 2023 -0400
Ensure integ tests run with security after plugin rename (#1023)
* Ensure integ tests run with security after plugin rename
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Rename to time-series-analytics
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Switch folder back
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Run integTest with -i
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Remove opensearch-anomaly-detection if installed
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update password rules and change expected error msg
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update password generation
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Fix indexOf condition
Signed-off-by: Craig Perkins <cwperx@amazon.com>
---------
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 72210f014ab54bf4a5b567ebe9dabe13b66c6cbb
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:39 2023 -0700
dependabot: bump codecov/codecov-action from 1 to 3 (#1038)
Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 1 to 3.
- [Release notes](https://github.com/codecov/codecov-action/releases)
- [Changelog](https://github.com/codecov/codecov-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/codecov/codecov-action/compare/v1...v3)
---
updated-dependencies:
- dependency-name: codecov/codecov-action
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit b77c3a7406e94424550ec1f22f084bc20533994f
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:14 2023 -0700
dependabot: bump com.google.guava:guava from 32.0.1-jre to 32.1.2-jre (#1037)
Bumps [com.google.guava:guava](https://github.com/google/guava) from 32.0.1-jre to 32.1.2-jre.
- [Release notes](https://github.com/google/guava/releases)
- [Commits](https://github.com/google/guava/commits)
---
updated-dependencies:
- dependency-name: com.google.guava:guava
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 18defcc16e81abe590e8f109d6df3c4a060f74ce
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:13:03 2023 -0700
dependabot: bump VachaShah/backport from 1.1.4 to 2.2.0 (#1039)
Bumps [VachaShah/backport](https://github.com/vachashah/backport) from 1.1.4 to 2.2.0.
- [Release notes](https://github.com/vachashah/backport/releases)
- [Changelog](https://github.com/VachaShah/backport/blob/main/CHANGELOG.md)
- [Commits](https://github.com/vachashah/backport/compare/v1.1.4...v2.2.0)
---
updated-dependencies:
- dependency-name: VachaShah/backport
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 726759f104117e1a28648a1524cdface49168b79
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:53 2023 -0700
dependabot: bump actions/checkout from 2 to 4 (#1041)
Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v2...v4)
---
updated-dependencies:
- dependency-name: actions/checkout
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit f6ac01886a662264323d1e11a2199fb190148c80
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:38 2023 -0700
dependabot: bump org.jacoco:org.jacoco.ant from 0.8.5 to 0.8.10 (#1044)
Bumps [org.jacoco:org.jacoco.ant](https://github.com/jacoco/jacoco) from 0.8.5 to 0.8.10.
- [Release notes](https://github.com/jacoco/jacoco/releases)
- [Commits](https://github.com/jacoco/jacoco/compare/v0.8.5...v0.8.10)
---
updated-dependencies:
- dependency-name: org.jacoco:org.jacoco.ant
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit d30bcc394e6f281b6de504f102a0085ae56e78e4
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Mon Sep 11 11:12:22 2023 -0700
dependabot: bump org.junit.jupiter:junit-jupiter-api (#1043)
Bumps [org.junit.jupiter:junit-jupiter-api](https://github.com/junit-team/junit5) from 5.9.2 to 5.10.0.
- [Release notes](https://github.com/junit-team/junit5/releases)
- [Commits](https://github.com/junit-team/junit5/compare/r5.9.2...r5.10.0)
---
updated-dependencies:
- dependency-name: org.junit.jupiter:junit-jupiter-api
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 92256db92f9ed78cb1de9925297c9ff5cce6da74
Author: Craig Perkins <cwperx@amazon.com>
Date: Mon Sep 11 14:04:23 2023 -0400
Add dependabot.yml (#1026)
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit 23611f6d8ccdc9a4c41469ec0a4746290f976b4f
Author: Jackie Han <hnyng@amazon.com>
Date: Fri Sep 8 11:19:31 2023 -0700
Add 2.10 release notes (#1031)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit ee1db57058e08c36e4820637973f18016cf45015
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Wed Sep 6 16:55:00 2023 -0700
Updates demo certs for integ tests (#1018)
Signed-off-by: Owais Kazi <owaiskazi19@gmail.com>
commit 338d72eb692c81802a70fe42556cde70c01cad6a
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Sep 6 16:08:01 2023 -0700
refactor job response (#1017)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit db456c2543a6f1ff6b77db10bd19952768d16182
Author: Jackie Han <hnyng@amazon.com>
Date: Tue Sep 5 15:47:50 2023 -0700
upgrading commons-lang3 version to fix conflict issue (#1012)
* force commons-lang3 version to fix conflict issue
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from upstream version properties file
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* getting commons-lang3 version from core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* upgrading commons-lang3 version to align with core
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit db788f4714233121eba4238869b8db89ae0037d4
Author: Owais Kazi <owaiskazi19@gmail.com>
Date: Tue Sep 5 13:58:31 2023 -0700
Adds auto release workflow (#1003)
Signed-off-by: owaiskazi19 <owaiskazi19@gmail.com>
commit 327c141e9b70465b1760f9ebf8c001a2e439b01f
Author: Jackie Han <hnyng@amazon.com>
Date: Fri Sep 1 13:00:23 2023 -0700
Revert "Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards (#948)" (#999)
This reverts commit bc1649922ef39619424fc16c64af5836e48a4a12.
commit 4a09b741e1c127a92775cb55f4c56aa5c4f3f6a3
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Aug 21 11:21:36 2023 -0700
Update Gradle Wrapper to 8.2.1 for Enhanced JDK20 Compatibility (#985)
- **Reason for Upgrade**: The migration to JDK20 ([reference](https://github.com/opensearch-project/opensearch-build/blob/aa65a8ecd69f77c3d3104043dd1c48dff708bffa/manifests/3.0.0/opensearch-3.0.0.yml#L9)) rendered the current Gradle version (7.6.1) incompatible.
- **Actions Taken**:
- **Gradle Wrapper Update**: Upgraded the Gradle wrapper to version 8.2.1 to maintain compatibility with JDK20. The gradle wrapper files are generated using the `./gradlew wrapper` command.
- Applied `spotless` due to new formatting requirements in Gradle 8.
- Resolved test "jar hell" issues. Gradle 8 introduced internal JARs to the test classpath that conflicted with dependencies from `org.junit.vintage:junit-vintage-engine`. As a remedy, these conflicting JARs have been excluded.
- **Relevant Pull Requests**:
- [Alerting#893](https://github.com/opensearch-project/alerting/pull/893/files)
- [ML-Commons#892](https://github.com/opensearch-project/ml-commons/pull/892)
- [Security PR](https://github.com/opensearch-project/security/pull/2978)
- **Verification**: Successfully verified the changes using `gradle build`.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 5ac6390e7de643d8177f0a5833995032f3a279ad
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Aug 17 11:08:36 2023 -0700
Refactoring task cache manager for forecasting (#982)
* Refactoring Shared Functionality for Broader Task Compatibility
This PR extracts shared components from `ADTaskCacheManager` into `TaskCacheManager` to support the requirements of the forecasting feature.
**Renamings**:
- **Method-level in `ADTaskCacheManager`**:
- `addDeletedDetector` to `addDeletedConfig`
- `addDeletedDetectorTask` to `addDeletedTask`
- `hasDeletedDetectorTask` to `hasDeletedTask`
- `pollDeletedDetector` to `pollDeletedConfig`
- `pollDeletedDetectorTask` to `pollDeletedTask`
- **Variable-level in `AnomalyDetectorSettings`**:
- `CHECKPOINT_MAINTAIN_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_MAINTAIN_QUEUE_MAX_HEAP_PERCENT`
- `CHECKPOINT_READ_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_READ_QUEUE_MAX_HEAP_PERCENT`
- `CHECKPOINT_SAVING_FREQ` to `AD_CHECKPOINT_SAVING_FREQ`
- `CHECKPOINT_TTL` to `AD_CHECKPOINT_TTL`
- `CHECKPOINT_WRITE_QUEUE_MAX_HEAP_PERCENT` to `AD_CHECKPOINT_WRITE_QUEUE_MAX_HEAP_PERCENT`
- `COLD_ENTITY_QUEUE_MAX_HEAP_PERCENT` to `AD_COLD_ENTITY_QUEUE_MAX_HEAP_PERCENT`
- `DEDICATED_CACHE_SIZE` to `AD_DEDICATED_CACHE_SIZE`
- `ENTITY_COLD_START_QUEUE_CONCURRENCY` to `AD_ENTITY_COLD_START_QUEUE_CONCURRENCY`
- `ENTITY_COLD_START_QUEUE_MAX_HEAP_PERCENT` to `AD_ENTITY_COLD_START_QUEUE_MAX_HEAP_PERCENT`
- `EXPECTED_COLD_ENTITY_EXECUTION_TIME_IN_MILLISECS` to `AD_EXPECTED_COLD_ENTITY_EXECUTION_TIME_IN_MILLISECS`
- `FILTER_BY_BACKEND_ROLES` to `AD_FILTER_BY_BACKEND_ROLES`
- `MAX_ENTITIES_PER_QUERY` to `AD_MAX_ENTITIES_PER_QUERY`
- `MAX_MODEL_SIZE_PER_NODE` to `AD_MAX_MODEL_SIZE_PER_NODE`
- `MAX_MULTI_ENTITY_ANOMALY_DETECTORS` to `AD_MAX_HC_ANOMALY_DETECTORS`
- `MAX_RETRY_FOR_END_RUN_EXCEPTION` to `AD_MAX_RETRY_FOR_END_RUN_EXCEPTION`
- `MAX_SINGLE_ENTITY_ANOMALY_DETECTORS` to `AD_MAX_SINGLE_ENTITY_ANOMALY_DETECTORS`
- `MODEL_MAX_SIZE_PERCENTAGE` to `AD_MODEL_MAX_SIZE_PERCENTAGE`
- `PAGE_SIZE` to `AD_PAGE_SIZE`
- `RESULT_WRITE_QUEUE_MAX_HEAP_PERCENT` to `AD_RESULT_WRITE_QUEUE_MAX_HEAP_PERCENT`
- **Class-level**:
- `ADRealtimeTaskCache` renamed to `RealtimeTaskCache`
- **Package-level**:
- Shifted from `org.opensearch.ad.breaker` to `org.opensearch.timeseries.breaker`
**Migrations**:
- Variables transferred from `AnomalyDetectorSettings` to `TimeSeriesSettings`:
- `BATCH_BOUNDING_BOX_CACHE_RATIO`
- `CHECKPOINT_MAINTAIN_REQUEST_SIZE_IN_BYTES`
- `CHECKPOINT_WRITE_QUEUE_SIZE_IN_BYTES`
- `DEFAULT_AD_JOB_LOC_DURATION_SECONDS` (renamed to `DEFAULT_JOB_LOC_DURATION_SECONDS`)
- `ENTITY_REQUEST_SIZE_IN_BYTES`
- `HOURLY_MAINTENANCE`
- `INTERVAL_RATIO_FOR_REQUESTS`
- `LOW_SEGMENT_PRUNE_RATIO`
- `MAINTENANCE_FREQ_CONSTANT`
- `MAX_COLD_START_ROUNDS`
- `MAX_QUEUED_TASKS_RATIO`
- `MAX_TOTAL_RCF_SERIALIZATION_BUFFERS`
- `MAX_CHECKPOINT_BYTES`
- `MEDIUM_SEGMENT_PRUNE_RATIO`
- `NUM_MIN_SAMPLES`
- `NUM_SAMPLES_PER_TREE`
- `NUM_TREES`
- `QUEUE_MAINTENANCE`
- `RESULT_WRITE_QUEUE_SIZE_IN_BYTES`
- `SERIALIZATION_BUFFER_BYTES`
- `THRESHOLD_MIN_PVALUE`
- `TIME_DECAY`
**Deletions**:
- Obsolete settings and methods:
- `DESIRED_MODEL_SIZE_PERCENTAGE` in `AnomalyDetectorSettings`
- `getDesiredModelSize` in `MemoryTracker`
**Modifications**:
- `MemoryTracker` enums renamed for clear differentiation between real-time and historical memory usage, adding `REAL_TIME_FORECASTER` for a harmonized single-stream and HC analysis approach.
**Tests**:
- Changes validated with a successful Gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 0c5b4b94cb5b192160463fa8a5f58eac587fe95d
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Aug 15 13:09:17 2023 -0700
Update RCF to v3.8 and Enable Auto AD with 'Alert Once' Option (#979)
* Update RCF to v3.8 and Enable Auto AD with 'Alert Once' Option
This PR added support for automatic Anomaly Detection (AD) and the 'Alert Once' option introduced in RCF 3.8.
Testing done:
1. Deserialization Test:
* Verified model deserialization from 3.0-rc3.
* Ensured consistent scoring using the rc3 checkpoint and rc3 dependency on identical data.
2. Backward Compatibility Test:
* Executed a mixed cluster with versions 2.10 and 3.0.
* Validated that older detectors still produce results without throwing any exceptions in a blue-green simulation scenario.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* reduce recall since alertOnce reduced recall
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* remove commented out code
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit cadc9bbd949daf4f2669335bfb8629e2137c108d
Author: Joshua Palis <jpalis@amazon.com>
Date: Fri Aug 11 16:02:38 2023 -0700
Fixing imports, adding TermsAggregator BucketCountThresholds for StringTerms, setting AnomalyResult grade to 0 if negative value (#976)
Signed-off-by: Joshua Palis <jpalis@amazon.com>
commit 3985cd2f82f2cfa57604ecf5a512bb042e632cae
Author: Romain Tartière <romain@blogreen.org>
Date: Wed Aug 9 08:59:30 2023 -1000
Fix build with latest OpenSearch (for real this time) (#972)
This is a follow-up to #971, where commit
2839bc2c6f470639b68901086c80cb2152d96558 only fixed _some_ but not _all_
of the build errors (it allowed `./gradlew run` to pass but `./gradlew
build` was failing).
Fix the build errors when we run `./gradlew build`.
Signed-off-by: Romain Tartière <romain@blogreen.org>
commit 2839bc2c6f470639b68901086c80cb2152d96558
Author: Romain Tartière <romain@blogreen.org>
Date: Tue Aug 8 13:15:04 2023 -1000
Fix build with latest OpenSearch (#971)
OpenSearch recently merged some code that cause buid failure for this
module, as spotted in #585.
This change the import to match the new one after
https://github.com/opensearch-project/OpenSearch/pull/9103
Signed-off-by: Romain Tartière <romain@blogreen.org>
commit d4946f04e7ad44f0bc79215962c6678786c592ff
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Aug 7 14:21:56 2023 -0700
Refactor ADTask and Related Components (#969)
* Refactor ADTask and Related Components
This PR includes several key refactoring changes:
- Extracts common code from ADTask into TimeSeriesTask, creating ForecastTask for forecasting-specific logic.
- Consolidates common code from ADTaskType into TaskType and introduces ForecastTaskType for forecasting-related purposes.
- Renames ADTaskState to TaskState for consistent code reuse.
- Renames the method getId in ADTask to getConfigId to differentiate it from other IDs like task id.
Testing done:
1. Added unit tests for the new code to ensure functionality.
2. Executed a successful Gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* add comments and address compiler errors
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Amit's comments and address compiler failure
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 1130a1ba6fc3c08f375dd99f98e93e4ee36331fb
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jul 27 10:39:39 2023 -0700
Refactoring NodeStateManager etc. to support forecasting functionality (#965)
* Refactoring NodeStateManager etc. to support forecasting functionality
This commit extends the codebase to support both Anomaly Detection (AD) and forecasting. It contains a mixture of refactoring, renaming, removal of unused code, and package moving tasks. Here are the details:
Refactoring:
- `NodeStateManager.getAnomalyDetector` is now `getConfig`, with added functionality to fetch a Forecaster. The method comments are updated for clarity.
- Existing methods (`getFeatureSamplesForPeriods`, `getColdStartSamplesForPeriods`, `createPreviewSearchRequest`, `getMinDataTime`) have been added in `SearchFeatureDao` to handle forecasting logic.
- Adjusted `SecurityClientUtil` and `ParseUtils` to handle forecasting logic.
- Cleaned up `NodeState` to differentiate state for AD and forecasting.
Renaming:
- `AnomalyDetectorJob` is renamed to `Job` to facilitate reuse for forecasting.
- `NodeStateManager.getAnomalyDetectorJob` is renamed to `getJob`.
- Certain settings in `AnomalyDetectorSettings` are renamed to reflect they are meant for the AD setting. They have been marked as deprecated and new settings are used in `TimeSeriesSettings` instead.
- `IndexAnomalyDetectorJobActionHandler.getAnomalyDetectorJobForWrite` is renamed to `getJobForWrite`.
- `ADSafeSecurityInjector` is renamed to `TimeSeriesSafeSecurityInjector`.
Removing unused code:
- Synchronous code in `ClientUtil`, `IndexUtils`, and `CheckpointDao` is removed.
- The unused class `Throttler` is deleted.
- Mapping file names are changed, and the code referencing these files is adjusted.
Package moving:
- Several classes (`ClientUtil`, `MultiResponsesDelegateActionListener`, `SafeSecurityInjector`, `SecurityUtil`, `ExceptionUtil`, `SearchFeatureDao`, `CleanState`, `ExpiringState`, `MaintenanceState`, `NodeState`, `SingleStreamModelIdMapper`, `BackPressureRouting`) are moved to the respective `org.opensearch.timeseries` packages.
Miscellaneous:
- Fixed compiler failures caused by changes in https://github.com/opensearch-project/OpenSearch/pull/8730 by replacing `DoubleArrayList` with `java.util.ArrayList`.
- Updates the Backwards Compatibility (bwc) version to align with the core's incremented bwc version as per [OpenSearch PR #8670](https://github.com/opensearch-project/OpenSearch/pull/8670). This change prevents the issue described in [OpenSearch Issue #5076](https://github.com/opensearch-project/OpenSearch/issues/5076).
Testing:
- Executed a `gradle build`.
- Added new tests for `ClientUtil` and `NodeStateManager`.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve comment
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* fix compiler error and comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit f0ed43b1aa3c5d80dc6f23a5dd4465bb03ef1739
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jul 17 15:18:03 2023 -0700
Rename AD to time series analytics & Resolve Compiler Errors (#951)
This commit focuses on renaming the AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin as well as addressing compiler errors due to package import changes. The primary transformations are:
* Renamed AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin.
* Updated all references from AnomalyDetectorPlugin to TimeSeriesAnalyticsPlugin.
* Amended plugin information in build.gradle and src/main/resources/es-plugin.properties.
* Switched job type in TimeSeriesAnalyticsPlugin from opendistro_anomaly_detector to opensearch_time_series_analytics.
These changes led to the modification of our plugin binary from opensearch-anomaly-detection-3.0.0.0-SNAPSHOT.jar to opensearch-time-series-analytics-3.0.0.0-SNAPSHOT.jar.
Moreover, following changes from OpenSearch Pull Request #8157, compiler errors were encountered, which were resolved by updating the import packages
* org.opensearch.common.io.stream.NamedWriteableRegistry => org.opensearch.core.common.io.stream.NamedWriteableRegistry
* org.opensearch.common.xcontent.XContentParserUtils => * org.opensearch.core.xcontent.XContentParserUtils
* org.opensearch.common.bytes.BytesArray => org.opensearch.core.common.bytes.BytesArray * org.opensearch.common.io.stream.StreamInput => * org.opensearch.core.common.io.stream.StreamInput ** org.opensearch.common.io.stream.StreamOutput => org.opensearch.core.common.io.stream.StreamOutput
* org.opensearch.common.io.stream.Writeable => org.opensearch.core.common.io.stream.Writeable
* org.opensearch.common.io.stream.NotSerializableExceptionWrapper => org.opensearch.core.common.io.stream.NotSerializableExceptionWrapper
* org.opensearch.rest.RestStatus => org.opensearch.core.rest.RestStatus
* org.opensearch.common.ParsingException => org.opensearch.core.common.ParsingException
* org.opensearch.common.bytes.BytesReference => org.opensearch.core.common.bytes.BytesReference
* org.opensearch.common.io.stream.InputStreamStreamInput => org.opensearch.core.common.io.stream.InputStreamStreamInput
* org.opensearch.common.io.stream.OutputStreamStreamOutput => org.opensearch.core.common.io.stream.OutputStreamStreamOutput
* org.opensearch.index.shard.ShardId => org.opensearch.core.index.shard.ShardId* org.opensearch.index.Index => org.opensearch.core.index.Index
* org.opensearch.core.index.IndexNotFoundException => org.opensearch.index.IndexNotFoundException
Validation steps were executed to ensure these changes did not break functionality:
* gradle build was successful. A local build was required due to outdated OpenSearch and job scheduler nightly builds.
* Backward compatibility tests were performed on a two-node 2.9 cluster running some detectors. These detectors continued to produce results on a 3.0 cluster with these updates.
* I can start new detectors on the 3.0 node.
* After shutting down a 2.9 node, the job transfer to the 3.0 node was successful and the job continued to perform as expected.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit c7c6a46e88e15f615fc9dae0499cf0d674662057
Author: Tyler Ohlsen <ohltyler@amazon.com>
Date: Thu Jul 13 15:42:46 2023 -0700
Add 2.9 release notes (#952)
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
commit bc1649922ef39619424fc16c64af5836e48a4a12
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue Jul 11 13:34:09 2023 -0700
Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards (#948)
* Enforce DOCUMENT Replication for AD Indices and Adjust Primary Shards
In this PR, we temporarily enforce DOCUMENT replication for AD indices. This change is necessary due to the current limitation of SegRep, which doesn't support Get/MultiGet by ID. This measure will be in place until SegRep adds support for these operations.
This adjustment aligns with the modification made in the referenced PR: job-scheduler PR #417
Additionally, this PR increases the number of primary shards for forecasting indices from 10 to 20, recognizing the higher write intensity of these indices. For instance, when the horizon is 24, we are expected to save 25 documents: 24 for each forecast and 1 for the actual value. In contrast, for AD, we save one document per actual value.
Testing done:
1. gradle build passed
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Fix comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit a1203827617ee42b35d41cb8b010719f334f73b7
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jul 10 10:53:17 2023 -0700
Add ForecastResult and Refactor Shared Code (#941)
This commit adds the functionality of ForecastResult, while also performing several necessary refactorings.
Firstly, we introduce ForecastResult, which closely mirrors the functionality of AnomalyResult. Any shared code between these two classes has been abstracted out into a new parent class, IndexableResult. This refactoring was undertaken to facilitate code reuse and improve maintainability, as both classes deal with storing fields that need to be saved in result indices.
Secondly, we've also extracted common code from ThresholdingResult into another new class, IntermediateResult. This work is in preparation for a forthcoming PR which will introduce RCFCasterResult. In this change, we moved the 'toAnomalyResult' method to IndexableResult, and renamed it to 'toIndexableResults'. This renaming allows for reuse in the upcoming RCFCasterResult. The updated method now returns a list of results instead of a single result. The shift caters for the RCFCasterResult use case where one RCFCasterResult is stored across multiple ForecastResult documents.
Furthermore, this commit modifies the 'entity' field in several methods to be of the Optional type, indicating that it can be empty. This change provides a clear signal to other developers about the optional nature of these fields.
In addition, this commit updates the mapping for the forecast result index. The prior mapping was a placeholder and this change brings it up to date.
We've also moved to using httpcore5 and httpclient5 versions from OpenSearch core, as necessitated by recent changes in [OpenSearch PR #8434](https://github.com/opensearch-project/OpenSearch/pull/8434/files). This shift resolves potential jar hell issues with httpcore5 and httpclient5.
Lastly, we've made name and package changes:
1. Renamed 'initDetectionStateIndex' in ADIndexManagement to 'initStateIndex' to align with ForecastIndexManagement naming.
2. Moved the 'DataByFeatureId' class to the 'timeseries' package for better organization.
This commit also completes the 'createDummyIndexRequest' method in ForecastIndexManagement by invoking 'ForecastResult.getDummyResult()', which is now possible due to the introduction of the ForecastResult implementation.
Testing done:
1. added tests for new code
2. gralde build passes
3. e2e tests
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit f24d9e32ff739abf29cac3da15fd00f74219e213
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date: Thu Jul 6 17:28:09 2023 -0700
Bump scipy from 1.8.0 to 1.10.0 in /dataGeneration (#943)
Bumps [scipy](https://github.com/scipy/scipy) from 1.8.0 to 1.10.0.
- [Release notes](https://github.com/scipy/scipy/releases)
- [Commits](https://github.com/scipy/scipy/compare/v1.8.0...v1.10.0)
---
updated-dependencies:
- dependency-name: scipy
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
commit 9b9fd2ba3f3e678d717c0a45af8069bb67828808
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Jun 27 16:08:55 2023 -0700
bump guava version to 32.0.1 (#933)
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit 99749dfa6bfc8a2f2c4660ca01d75d1ad57124a5
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jun 26 16:46:24 2023 -0700
Refactoring Index Creation for Improved Code Reuse and Consistency (#932)
This Pull Request significantly refactors the index creation module to promote greater code reusability and consistency. The primary changes are outlined as follows:
1. Code Migration: Common code segments have been moved from AnomalyDetectionIndices to IndexManagement. In addition, component-specific code has been established in ADIndexManagement and ForecastIndexManagement. The bulk of changes are concentrated in these three classes, with the remainder of the modifications relating to reference/test changes.
2. Function Renaming: Several functions have been renamed for broader applicability and consistency:
* AnomalyDetectorFunction has been renamed to ExecutorFunction for potential use in Forecasting.
* AnomalyDetectorSettings.MAX_PRIMARY_SHARDS has been renamed to AnomalyDetectorSettings.AD_MAX_PRIMARY_SHARDS in light of the new ForecastSettings.FORECAST_MAX_PRIMARY_SHARDS.
* doesAnomalyDetectorJobIndexExist() has been renamed to doesJobIndexExist() to allow for job index reusability across Anomaly Detection (AD) and forecasting. Analogous changes have been made to other job index-related functions.
* doesAnomalyDetectorIndexExist() has been renamed to doesConfigIndexExist() to allow for config index reusability across AD and forecasting. Analogous changes have been made to other config index-related functions.
* detectionIndices.doesDetectorStateIndexExist() has been renamed to detectionIndices.doesStateIndexExist(), as the former name was unnecessarily redundant. Similar modifications have been made to the result and checkpoint index.
3. Class Migration: The classes ThrowingSupplierWrapper, ThrowingConsumer, and ThrowingSupplier have been moved from org.opensearch.ad.util to org.opensearch.timeseries.function to promote code reuse.
4. Initial Forecast Indices' Mapping: An initial version of forecast indices' mapping has been added, which can be adjusted as required in the future.
5. In terms of version updates, 2.x has been bumped to 2.9, prompting an increment of the Backward Compatibility (BWC) test version to 2.9.
6. Update dependency com.google.guava:guava to v32 for cve fix.
Testing done:
Testing has been performed with new tests added for forecast index creation, and the grade build passes successfully.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit aedb781a6b1df984636d72d50b65d41138539918
Author: Craig Perkins <craig5008@gmail.com>
Date: Tue Jun 20 16:55:19 2023 -0400
Fix main build - update import of Releasable and remove reference to BaseExceptionsHelper (#930)
* Fix main build - update import of Releasable and remove reference to BaseExceptionsHelper
Signed-off-by: Craig Perkins <cwperx@amazon.com>
* Update imports in test classes
Signed-off-by: Craig Perkins <cwperx@amazon.com>
---------
Signed-off-by: Craig Perkins <cwperx@amazon.com>
commit fce78c29c0375ae06f56e16c85fb98933401e28f
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Jun 14 10:36:40 2023 -0700
Refactor: Reorganize code for Forecasting and AnomalyDetector packages (#925)
* Refactor: Reorganize code for Forecasting and AnomalyDetector packages
This PR includes several refactorings to increase code reuse and improve readability:
1. Entity, FeatureData, and RestHandlerUtils have been moved from the 'ad' package to the 'timeseries' package, enabling their use within the Forecasting code.
2. A new class, DataByFeatureId, has been created to hold shared code previously located in FeatureData. FeatureData now inherits from DataByFeatureId. The standalone usage of DataByFeatureId will be detailed in subsequent PRs.
3. Renamed checkAnomalyDetectorFeaturesSyntax to checkFeaturesSyntax in RestHandlerUtils to make it more generic and usable for Forecasting.
4. Constants AGG_NAME_MAX_TIME, AGG_NAME_MIN_TIME, DATE_HISTOGRAM, and FEATURE_AGGS have been moved from ADCommonName to CommonName to make them accessible for Forecasting.
5. A new method, parseConfig, has been added to the Config class. This method can parse configuration for either AnomalyDetector or Forecaster based on input.
Testing:
The changes have been validated with a successful gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Amit and Owais's comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 02c120f025f73f3d45a8477c7ef8b4873befebfa
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jun 12 11:54:39 2023 -0700
Updated Maintainers and CODE_OWNERS list (#926)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 2ea4dcf430b40a710a0babb04881eeff9fb2d689
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jun 8 15:11:44 2023 -0700
Add Forecaster class (#920)
* Add Forecaster class
This PR adds class Forecaster that serves as the configuration POJO for forecasting. Shared code between AnomalyDetector and Forecaster is extracted and moved to the Config class to reduce duplication and promote reusability. References to the common code in related classes have also been adjusted.
Testing done:
1. gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* fix compiler error due to a recent core change
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* address Sudipto and Amit's comments
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit ee04225349a5f0f003d56e77a3243386f4a9673d
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri Jun 2 15:42:19 2023 -0700
Refactor: Migrate files from 'ad' to 'timeseries' package (#918)
* Refactor: Migrate files from 'ad' to 'timeseries' package
This commit involves moving various files from the 'ad' package to the 'timeseries' package. All changes to dependent imports were handled automatically through the IDE, and no changes to file contents were made in the process.
Testing done:
- gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* move ParseUtils to util package
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 472868d165c2234eece8827584f64086aaf7ae92
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Jun 1 11:17:16 2023 -0700
Refactor Shared Settings, Introduce Dynamic Forecast Settings, Rename (#912)
* Refactor Shared Settings, Introduce Dynamic Forecast Settings, and Rename Checkpoint mapping File
This commit has undertaken three changes:
* Refactoring of Shared Settings: I've performed a refactoring to unify the settings that are shared between the AD and forecasting modules.
* Introduction of Dynamic Forecast Settings: To increase the adaptability of our system, I've implemented dynamic forecast settings. These settings mirror the existing structure of the AD dynamic settings and will enable us to adjust forecast settings on-the-fly.
* Renaming of Checkpoint File: To enhance the consistency across our AD mapping files, I've renamed checkpoint.json to anomaly-checkpoint.java.
Testing done:
1. added tests for new settings.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* name change and delete files
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 04ab91e60e9d71765a7b9df10b86e0e53ba4d715
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 31 12:18:54 2023 -0700
add 2.8 release notes (#915)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 98da8dffe8d336793ae35658015650b0f83aeef1
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 24 14:37:38 2023 -0700
Implementing Multiple Imputation Methods for Missing Values (#907)
* Implementing Multiple Imputation Methods for Missing Values
This Pull Request introduces multiple imputation methods to handle missing data in Anomaly Detection (AD) and forecasting. The ability to handle missing data is crucial to improve the robustness and accuracy of our models.
The following imputation methods have been implemented:
* Zero Imputation (ZERO): This method replaces all missing values with 0's. It's a simple approach, but it may introduce bias if the data is not centered around zero.
* Fixed Values Imputation (FIXED_VALUES): This method replaces missing values with a predefined set of values. The values are the same for each input dimension, and they need to be specified by the user.
* Previous Value Imputation (PREVIOUS): This method replaces missing values with the last known value in the respective input dimension. It's a commonly used method for time series data, where temporal continuity is expected.
* Linear Interpolation (LINEAR): This method estimates missing values by interpolating linearly between known values in the respective input dimension. This method assumes that the data follows a linear trend.
These methods are designed to provide a set of options for users to handle missing data based on their specific needs and the nature of their data.
Testing Done:
The code changes in this pull request have been validated through a gradle build to ensure that all new and existing tests pass successfully.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Various changes
The commit makes all new files use the shortened header text and addresses compiler/test issues due to core refactoring
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit da608aaa3d3f955efe32b0cb33b3c8cfdd7a7718
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue May 16 11:37:34 2023 -0700
Code Refactoring for CommonMessages (#902)
* Code Refactoring for CommonMessages
In this pull request, I have refactored the code related to shared log or error messages in both AD and forecasting modules to CommonMessages. Additionally, the previously used CommonErrorMessages has been renamed to ADCommonMessages. For the Forecasting module, I have introduced new names in ForecastCommonMessages.
Testing done:
* gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* Update string constants wording
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* improve wording and remove redundant variables
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 041d6ce73d37f1697013b2d2f0683fbfe012247c
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri May 12 13:05:56 2023 -0700
Code Refactoring for CommonName (#901)
In this pull request, I have refactored the code related to shared names in both AD and forecasting modules to CommonNames. Additionally, the previously used CommonName has been renamed to ADCommonName. For the Forecasting module, I have introduced new names in ForecastCommonNames.
Testing done:
* gradle build
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit e2fee9d6ba59cc2a23eadbb50a80414fcc7dbf8f
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed May 10 17:26:31 2023 -0700
Update outdated MAINTAINERS and OWNERS list (#898)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 98b566d1ec57ffd8970b5180c54b493deb1a24ac
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Wed May 10 18:03:04 2023 -0400
Sync up CODEOWNERS with MAINTAINERS.md. (#897)
Signed-off-by: dblock <dblock@amazon.com>
commit 1f8415aa39fa4ec3ba016214255aa0e79b7c7d63
Author: Kaituo Li <kaituo@amazon.com>
Date: Tue May 9 12:55:35 2023 -0700
Various fixes (#886)
* Various fixes
This pull request addresses several issues related to the compiler and tests in the current main branch.
The first major change involves replacing ImmutableOpenMap with java.util.Map in the core. This modification is implemented in the following pull requests:
https://github.com/opensearch-project/OpenSearch/pull/7165
https://github.com/opensearch-project/OpenSearch/pull/7301
To accommodate this change, the codebase of the AD (Anomaly Detection) module has been refactored to utilize JDK maps. As a consequence of this change, passing null to the custom parameters of ClusterState is no longer permissible, as it leads to a NullPointerException. The error stack trace is as follows:
java.lang.NullPointerException: Cannot invoke "Object.getClass()" because "m" is null
at __randomizedtesting.SeedInfo.seed([60CDDB34427ACD0C:6E72DB4ED18E018D]:0)
at java.base/java.util.Collections.unmodifiableMap(Collections.java:1476)
at org.opensearch.cluster.ClusterState.<init>(ClusterState.java:219)
at org.opensearch.ad.transport.DeleteAnomalyDetectorTests.createClusterState(DeleteAnomalyDetectorTests.java:216)
at org.opensearch.ad.transport.DeleteAnomalyDetectorTests.testDeleteADTransportAction_LatestDetectorLevelTask(DeleteAnomalyDetectorTests.java:160)
To address this issue, we have replaced the usage of null with new HashMap<>().
The second change in this pull request aligns with the modifications introduced in PR https://github.com/opensearch-project/anomaly-detection/pull/878.
The third issue is related to the incompatibility between tests that utilize the @Parameters annotation and those that do not, as explained in https://tinyurl.com/2y265s2w. Specifically, the SearchFeatureDaoTests class runes tests with the @Parameters annotation, whereas SearchFeatureDao tests do not.
Testing done:
1. gradle build.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 0a48da9e1a0cd70c64cc2da228674baaf377c89e
Author: Jackie Han <hnyng@amazon.com>
Date: Mon Apr 17 12:44:06 2023 -0700
Add 2.7 release notes (#871)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 1edc2ef1ccfe20938711984744b20d1f2ec96a3c
Author: Jackie Han <hnyng@amazon.com>
Date: Tue Apr 11 17:53:57 2023 -0700
Update OpenSearchRejectedExecutionException import (#861)
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update OpenSearchRejectedExecutionException import
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
* Update NodeInfo constructor and javadoc for isAdmin method
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
---------
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit b8df172c2364997c446096e960068d6fc5d2e6f6
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Apr 11 10:55:28 2023 -0700
Giving admin priority over backendrole filtering (#850)
* giving admin priority over backend role filtering
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
* fix security tests
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
* remove redundent line in test case
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
---------
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit fd2fd5d5f63c9004b9f265e3c1e4475282447da8
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Thu Mar 16 14:30:32 2023 -0400
Created untriaged issue workflow. (#809)
Signed-off-by: dblock <dblock@amazon.com>
commit fd547014fdde5114bbc9c8e49fe7aaa37eb6e793
Author: Kaituo Li <kaituo@amazon.com>
Date: Wed Mar 1 16:41:05 2023 -0800
Publish snapshots to maven via GHA, fix spotless errors, and bump bwc version (#827)
We are de-coupling the task of publishing the maven snapshots from centralized build workflow to individual repositories. This PR publishes maven snapshots using GitHub Actions.
Testing done:
1. ran ./gradlew publishPluginZipPublicationToSnapshotsRepository according to https://github.com/opensearch-project/anomaly-detection/issues/813
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit b6be5960fb8cff41f0e9d13d5f5a971c289b80ed
Author: Jackie Han <hnyng@amazon.com>
Date: Thu Feb 23 12:23:01 2023 -0800
Update xcontent imports (#822)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 1dcb78a6c4d1331133aefe5af7adf137daa8846f
Author: Jackie Han <hnyng@amazon.com>
Date: Wed Feb 22 11:17:21 2023 -0800
Add 2.6 release note (#818)
Signed-off-by: Jackie Han <jkhanjob@gmail.com>
commit 553688aae45590c37cc4d86102642d0b3a6ebb33
Author: Kaituo Li <kaituo@amazon.com>
Date: Thu Feb 9 13:38:14 2023 -0800
Revert changes to exception message (#803)
* Revert changes to exception message
We used to log "No RCF models are available either because RCF models are not ready..." and now we log "resource_not_found_exception: No checkpoints found for model id...". This change caused an integration test failure. This PR reverts it back.
Testing done:
1. verified that the original log is back.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
* check NO_MODEL_ERR_MSG instead of NO_CHECKPOINT_ERR_MSG
Signed-off-by: Kaituo Li <kaituo@amazon.com>
---------
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit c9bdc628a03c4ced3cd1ebeec44ebff792d7ff98
Author: Kaituo Li <kaituo@amazon.com>
Date: Fri Feb 3 11:15:37 2023 -0800
fixing dls/fls logic around numeric aggregations (#801)
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 9cebc5bc97a84dd78ac8892863ff7d674428bced
Author: Amit Galitzky <amgalitz@amazon.com>
Date: Tue Jan 10 02:17:04 2023 +0000
adding 2.5 release notes
Signed-off-by: Amit Galitzky <amgalitz@amazon.com>
commit 2ace84643fd199a5e5179e6d21ab76ae212cb7d8
Author: Ryan Bogan <10944539+ryanbogan@users.noreply.github.com>
Date: Tue Jan 10 13:31:49 2023 -0800
Add jackson back to build.gradle (#780)
Signed-off-by: Ryan Bogan <rbogan@amazon.com>
commit a5d60eefab5ac30ef5243da8e7a88b7a2189cd5c
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jan 9 15:49:35 2023 -0800
bump bwc to 2.6.0 (#775)
We need to bump the version because only the latest 2.x will be upgradable to 3.0 when that ship. Since OpenSearch core bumped to 2.6, we need to do that as well. Note after bumping version, bwc still fails to find 2.6.0 core zip.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit 27ed49863bfbef90551cdfacc6b51703bf622e25
Author: Kaituo Li <kaituo@amazon.com>
Date: Mon Jan 9 12:17:57 2023 -0800
Fix the discrepancy between Profile API and real time tasks API (#770)
* Fix the discrepancy between Profile API and real time tasks API
This PR fixes the discrepancy by querying the result index when the total updates is less than 32. We have done similar things in profile API so I refactored reusable code to ProfileUtil. We also cached whether we have queried the result index and won't repeatedly issue the extra query.
Testing done:
1. repeated repro steps in https://github.com/opensearch-project/anomaly-detection/issues/502 and verified the issue has been resolved.
Signed-off-by: Kaituo Li <kaituo@amazon.com>
commit b49a36b3e7962a205695d451e0497ee4f57fb2cb
Author: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Date: Thu Jan 5 10:19:51 2023 -0800
Updated MAIN…
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Remove default admin credentials
admin:adminIssues Resolved
#1120
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.