Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Remote Routing Table] Add write flow for remote routing table #13870

Merged
merged 66 commits into from
Jun 10, 2024

Conversation

himshikha
Copy link
Contributor

@himshikha himshikha commented May 29, 2024

Description

This change adds write flow for uploading routing table to remote store during cluster state publication.

This is dependent on base PRs #13304 and #13577

Related Issues

Resolves ##14033

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • API changes companion pull request created.
  • Failing checks are inspected and point to the corresponding known issue(s) (See: Troubleshooting Failing Builds)
  • Commits are signed per the DCO using --signoff
  • Commit changes are listed out in CHANGELOG.md file (See: Changelog)
  • Public documentation issue/PR created

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

himshikha and others added 30 commits April 19, 2024 16:12
Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
Signed-off-by: Bukhtawar Khan <bukhtawa@amazon.com>
Signed-off-by: Bukhtawar Khan <bukhtawa@amazon.com>
Signed-off-by: Bukhtawar Khan <bukhtawa@amazon.com>
Signed-off-by: Bukhtawar Khan <bukhtawa@amazon.com>
Signed-off-by: Bukhtawar Khan <bukhtawa@amazon.com>
Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
Signed-off-by: Arpit Bandejiya <abandeji@amazon.com>
Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
Signed-off-by: Himshikha Gupta <gupta.himshikha@gmail.com>
Signed-off-by: Arpit Bandejiya <abandeji@amazon.com>
Signed-off-by: Arpit Bandejiya <abandeji@amazon.com>
Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
Signed-off-by: Himshikha Gupta <gupta.himshikha@gmail.com>
Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
@Bukhtawar Bukhtawar added backport 2.x Backport to 2.x branch and removed backport 2.x Backport to 2.x branch backport-failed labels Jun 10, 2024
@opensearch-trigger-bot
Copy link
Contributor

The backport to 2.x failed:

The process '/usr/bin/git' failed with exit code 128

To backport manually, run these commands in your terminal:

# Navigate to the root of your repository
cd $(git rev-parse --show-toplevel)
# Fetch latest updates from GitHub
git fetch
# Create a new working tree
git worktree add ../.worktrees/OpenSearch/backport-2.x 2.x
# Navigate to the new working tree
pushd ../.worktrees/OpenSearch/backport-2.x
# Create a new branch
git switch --create backport/backport-13870-to-2.x
# Cherry-pick the merged commit of this pull request and resolve the conflicts
git cherry-pick -x --mainline 1 1084ba9b167af8342be0acea075c83fa1673dcb1
# Push it to GitHub
git push --set-upstream origin backport/backport-13870-to-2.x
# Go back to the original working tree
popd
# Delete the working tree
git worktree remove ../.worktrees/OpenSearch/backport-2.x

Then, create a pull request where the base branch is 2.x and the compare/head branch is backport/backport-13870-to-2.x.

himshikha added a commit to himshikha/OpenSearch that referenced this pull request Jun 11, 2024
…earch-project#13870)

* Introduce RemoteRoutingTableService for shard routing table management

Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
Co-authored-by: Bukhtawar Khan <bukhtawa@amazon.com>
Co-authored-by: Arpit Bandejiya <abandeji@amazon.com>
himshikha added a commit to himshikha/OpenSearch that referenced this pull request Jun 11, 2024
…earch-project#13870)

* Introduce RemoteRoutingTableService for shard routing table management

Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
Co-authored-by: Bukhtawar Khan <bukhtawa@amazon.com>
Co-authored-by: Arpit Bandejiya <abandeji@amazon.com>
shwetathareja pushed a commit that referenced this pull request Jun 11, 2024
…g table (#13870) (#14160)

* [Remote Routing Table] Add write flow for remote routing table (#13870)

* Introduce RemoteRoutingTableService for shard routing table management

Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
Co-authored-by: Bukhtawar Khan <bukhtawa@amazon.com>
Co-authored-by: Arpit Bandejiya <abandeji@amazon.com>
kkewwei pushed a commit to kkewwei/OpenSearch that referenced this pull request Jul 24, 2024
…g table (opensearch-project#13870) (opensearch-project#14160)

* [Remote Routing Table] Add write flow for remote routing table (opensearch-project#13870)

* Introduce RemoteRoutingTableService for shard routing table management

Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
Co-authored-by: Bukhtawar Khan <bukhtawa@amazon.com>
Co-authored-by: Arpit Bandejiya <abandeji@amazon.com>
Signed-off-by: kkewwei <kkewwei@163.com>
wdongyu pushed a commit to wdongyu/OpenSearch that referenced this pull request Aug 22, 2024
…earch-project#13870)

* Introduce RemoteRoutingTableService for shard routing table management 

Signed-off-by: Himshikha Gupta <himshikh@amazon.com>
Co-authored-by: Bukhtawar Khan <bukhtawa@amazon.com>
Co-authored-by: Arpit Bandejiya <abandeji@amazon.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport 2.x Backport to 2.x branch backport-failed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants