Releases: opensearch-project/opensearch-migrations
Releases · opensearch-project/opensearch-migrations
2.1.1
What's Changed
- Fix several minor issues in RFS codebase by @peternied in #1161
- More consistent index template allow list behavior by @peternied in #1174
- Fix bug handle empty mappings when removing mapping types by @peternied in #1178
- Address all outstanding sonarqube docker issues by @peternied in #1175
- Adding subshard work items on lease expiry by @chelma in #1160
- MIGRATIONS-2243 - Replace 'Shards' verbiage with 'Fragment' in console backfill status by @sumobrian in #1179
- Revert "Adding subshard work items on lease expiry" by @mikaylathompson in #1183
- Bump django from 5.1.1 to 5.1.4 in /TrafficCapture/dockerSolution/src/main/docker/migrationConsole/console_api by @dependabot in #1184
- Fix log message when unable to find a reference id for a document by @peternied in #1187
- Type mappings transformation by @gregschohn in #1154
- Flip the default should throw behavior for HttpJsonMessageWithFaultingPayload by @gregschohn in #1176
- Add MultiTypeMappingTransformation and test by @AndreKurait in #1189
- Reduce the number of cluster start/stops for Metadata end to end tests by @peternied in #1186
- For backfill bulk items, don't transcribe the documents through jinjava but just have it pulled from the source doc. by @gregschohn in #1191
- Fix display of
console replay status
by @mikaylathompson in #1193 - Add robustness for missing TupleComponents by @mikaylathompson in #1194
- Address a number of sonarqube java issues by @peternied in #1181
- Enable MultiTypeMappingTransformationTest by @AndreKurait in #1195
- Update Issue and PR templates by @peternied in #1196
- Capture memory leak failures during tests by @peternied in #1188
- Fix OSB on specific working workload commit by @AndreKurait in #1202
- Update VERSION to 2.1.1 by @gregschohn in #1201
- Add Demo Testing Fixes/Improvements by @lewijacn in #1197
Full Changelog: 2.1.0...2.1.1
2.1.0
What's Changed
- Frontend design doc by @peternied in #1112
- Bump aiohttp from 3.10.3 to 3.10.11 in /TrafficCapture/dockerSolution/src/main/docker/elasticsearchTestConsole by @dependabot in #1146
- Added initial CloudWatch Dashboard for RFS by @chelma in #1147
- Read from a checkpoint for RFS by @mikaylathompson in #1149
- [Cluster tools] Set OpenSearch version for test containers by @lewijacn in #1152
- Sonarqube fixes from subshard work coordination by @mikaylathompson in #1151
- Hardcode AMIs for use in the bootstrap machine by @peternied in #1153
- Add VPCEndpoints on created VPC by @peternied in #1150
- Refactor online radix sorter by @gregschohn in #1156
- Add analysis workflows for SonarQube and CodeQL by @peternied in #1158
- [Jenkins] Add Solutions CFN Create VPC Test by @lewijacn in #1159
- [RFS] Use shard routing from source while bulk indexing. by @kanatti in #1164
- Add metadata transformations with metadata tuples by @AndreKurait in #1148
- Infer managedServiceSourceSnapshotEnabled when not set by @AndreKurait in #1165
- Add baseline sonarqube issue count by @AndreKurait in #1169
- Update VERSION to 2.1.0 by @sumobrian in #1167
New Contributors
Full Changelog: 2.0.4...2.1.0
2.0.4
What's Changed
- Include AWS Solution cloud formation template by @peternied in #1101
- Add linter to the migration cdk stack by @peternied in #1108
- [Bug] Cleanup deployment fix for paginated list stacks by @lewijacn in #1111
- Add Basic Jenkins Integ Test for Demo Setup by @lewijacn in #1099
- Generate two CFN templates for create VPC and import VPC for bootstrap by @lewijacn in #1113
- Rfs document transformations by @AndreKurait in #1110
- Update test ES 6.8 to use es-oss image by @AndreKurait in #1114
- Add unit tests for RemoteReaderClient by @AndreKurait in #1116
- Reformat log statements so that they aren't susceptible to formatting errors and worse when {} are in the message by @gregschohn in #1084
- Bump micromatch from 4.0.7 to 4.0.8 in /deployment/cdk/opensearch-service-migration by @lewijacn in #1119
- Auto detect target cluster version by @peternied in #1118
- Use CFN input for VPC id and Stage by @lewijacn in #1122
- Generate and output sbom in GHA by @AndreKurait in #1121
- Cluster tools by @AndreKurait in #1124
- [CDK] Validate source endpoint and add default port if missing by @lewijacn in #1125
- Quick updates to the RFS design doc, assuming a later pass by @chelma in #1127
- Metadata Support ES7+ Legacy Templates by @AndreKurait in #1128
- Update logging for cluster tools by @AndreKurait in #1126
- GHA trigger CI with pull_request_target for secrets access by @AndreKurait in #1132
- Update gradle-setup action to v4 to fix cache cleanup by @AndreKurait in #1134
- Create RFS successor work items by @mikaylathompson in #1104
- Capture the created role arn for snapshotting into the AWS yaml parameter and pass it through the command line by @gregschohn in #1133
- Split codecov upload to separate github actions workflow by @AndreKurait in #1139
- Style Linting: Placate Flake8 w/ more lines by @gregschohn in #1138
- Added
console backfill pause
,console backfill stop
archives working state by @chelma in #1140 - Codecov download token by @AndreKurait in #1141
- Update version to 2.0.4 by @AndreKurait in #1142
Full Changelog: 2.0.3...2.0.4
2.0.3
What's Changed
- Add reindexFromSnapshotWorkerSize to cdk with default and maximum modes by @AndreKurait in #1085
- Address code smells in DataGenerator by @peternied in #1076
- Remove unspecified dependencies in maven pom publishing by @AndreKurait in #1100
- DataGenerator readability improvements by @gregschohn in #1103
- Fix numWorkItemsArePending bug by @mikaylathompson in #1102
- Bump werkzeug from 3.0.3 to 3.0.6 in /TrafficCapture/dockerSolution/src/main/docker/migrationConsole/console_api by @dependabot in #1105
- Bump werkzeug from 3.0.3 to 3.0.6 in /TrafficCapture/dockerSolution/src/main/docker/migrationConsole/lib/console_link by @dependabot in #1106
- Implement Transformation JMES Path Predicates by @AndreKurait in #1086
Full Changelog: 2.0.2...2.0.3
2.0.2
What's Changed
- Change to bespoke spotless import spec to something more typical by @gregschohn in #1048
- Bump django from 5.1 to 5.1.1 in /TrafficCapture/dockerSolution/src/main/docker/migrationConsole/console_api by @dependabot in #1056
- Add a "cluster curl" tool by @mikaylathompson in #1046
- Add a script to determine the AWS resources used by @peternied in #1050
- Continue to evaulate / migrate after failures by @peternied in #1037
- Increase the RFS default scale to 5 by @peternied in #1057
- [Jenkins] Add delete environment pipeline by @lewijacn in #1055
- Added a simple, single document RFS ES 6.8 Jenkins Integ Test by @chelma in #1062
- Add DataGenerator tool by @peternied in #1059
- Remove reference to DMS by @sumobrian in #1065
- [CVE] Update snappy-java from 1.1.10.4 -> 1.1.10.6 by @peternied in #1063
- Add Transformation support for tuples by @AndreKurait in #1044
- Update root readme adding key features, repo structure details, user uide reference, jira reference, details for repo clarity. by @sumobrian in #1066
- Reformat some more @parameter definitions to be more readable by @gregschohn in #1052
- Removed an unnecessary method call by @chelma in #1075
- Allow more versions to be in scope by @peternied in #1051
- Remove elasticsearch from default capture proxy base image by @AndreKurait in #1061
- Make
--source-version
required by @peternied in #1058 - Switch pytest for integ test to INFO and minor top level cleanup by @lewijacn in #1078
- Expand target support to OpenSearch v1.3 by @peternied in #1074
- Replace requests-auth-aws-sigv4 with boto3 signing by @AndreKurait in #1077
- Update cdk ecr images when docker hash changes by @AndreKurait in #1080
- Include versions in maven publish by @AndreKurait in #1081
Full Changelog: 2.0.1...2.0.2
2.0.1
What's Changed
- Apply dependency overrides to all dependency types by @AndreKurait in #1040
- RFS Workers now use EBS to store/unpack the snapshot by @chelma in #1041
- Add spotless formatting rules for json files by @peternied in #1049
- Add a doc about the architecture of the migration console by @mikaylathompson in #1045
- Run the RFS Container's DocumentMigration application repeatedly as long as it's successful by @gregschohn in #1047
Full Changelog: 2.0.0...2.0.1
2.0.0
What's Changed
- Optimize the regex parser for InvalidResponse by @peternied in #1034
Full Changelog: 1.0.19...2.0.0
1.0.19
What's Changed
- ?v -> ?v=true to workaround the sigv4 bug by @mikaylathompson in #1031
- Add indexAllowlist to snapshot create command by @mikaylathompson in #1009
- Add option to take a snapshot of a managed service source cluster by @mikaylathompson in #1028
- Add note about not supporting customer managed keys by @mikaylathompson in #1025
- Removing unused logging utilities class by @peternied in #1032
Full Changelog: 1.0.18...1.0.19
1.0.18
What's Changed
- Update argument parsing to remove dependency on yargs and make more robust by @AndreKurait in #1019
- Upgrade protobuf version by @lewijacn in #1005
Full Changelog: 1.0.17...1.0.18
1.0.17
What's Changed
- Set explicit defaults w/ placeholders in the cdk.context.json by @mikaylathompson in #1021
- Make cdk.context.json valid json by @mikaylathompson in #1022
- Add snapshot delete to cli by @mikaylathompson in #1020
- Fixed bug in mapping parsing; added tests by @chelma in #1023
- Remove arg printing from command line apps with secret values by @AndreKurait in #1024
Full Changelog: 1.0.16...1.0.17