Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add PUT api to update shard routing weights #4272

Merged
merged 63 commits into from
Sep 27, 2022
Merged

Add PUT api to update shard routing weights #4272

merged 63 commits into from
Sep 27, 2022

Commits on Sep 1, 2022

  1. Weighted round-robin scheduling policy for shard coordination traffic… 

    … routing

Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 1, 2022
    Configuration menu
    Copy the full SHA
    162cbeb View commit details
    Browse the repository at this point in the history

  2. Add caching layer for wrr shard routing and moved wrr routing call to… 

    … shardRoutings

Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 1, 2022
    Configuration menu
    Copy the full SHA
    8513c4f View commit details
    Browse the repository at this point in the history

  3. Integrate ARS with weighted round robin, 

    Remove Cluster Settings for WRR
Add Code refactoring and Java docs

Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 1, 2022
    Configuration menu
    Copy the full SHA
    4cdbee3 View commit details
    Browse the repository at this point in the history

  4. Remove ARS and add tests for zone with undefined weight 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 1, 2022
    Configuration menu
    Copy the full SHA
    7a49e5c View commit details
    Browse the repository at this point in the history

  5. Add changelog for the commit 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 1, 2022
    Configuration menu
    Copy the full SHA
    03c4d23 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into feature/wrr-shard-routing-core

    @anshu1106
    anshu1106 authored Sep 1, 2022
    Configuration menu
    Copy the full SHA
    7c64537 View commit details
    Browse the repository at this point in the history

  7. Fix java doc, add test of WeightedRoundRobinRouting metadata 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 1, 2022
    Configuration menu
    Copy the full SHA
    154a3b9 View commit details
    Browse the repository at this point in the history

  8. Fix minor change related to shuffling wrr shard routings 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 1, 2022
    Configuration menu
    Copy the full SHA
    3afb4e3 View commit details
    Browse the repository at this point in the history

  9. Add PUT api for updating weighted round robin shard routing weights 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 1, 2022
    Configuration menu
    Copy the full SHA
    d9e2b08 View commit details
    Browse the repository at this point in the history

  10. Add more validations for request body for put wrr weights 

    Incorporate review comments and  more UTs

Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 1, 2022
    Configuration menu
    Copy the full SHA
    c3b847a View commit details
    Browse the repository at this point in the history

  11. Update thread pool executor and do code refactoring 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 1, 2022
    Configuration menu
    Copy the full SHA
    9cc2cd5 View commit details
    Browse the repository at this point in the history

  12. Fix missing java doc build failure 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 1, 2022
    Configuration menu
    Copy the full SHA
    f07a9ad View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2022

  1. Throw ActionRequestValidationException on invalid awareness attribute 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    e12d247 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into feature/wrr-shard-routing-core

    @anshu1106
    anshu1106 authored Sep 2, 2022
    Configuration menu
    Copy the full SHA
    30e17bc View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2022

  1. Add default weight 1 for zones with undefined weight 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 7, 2022
    Configuration menu
    Copy the full SHA
    3aa6fbb View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into feature/wrr-shard-rou… 

    …ting-core

Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 7, 2022
    Configuration menu
    Copy the full SHA
    9ae063c View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2022

  1. Inject WRRShardsCache on node start 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 12, 2022
    Configuration menu
    Copy the full SHA
    1112366 View commit details
    Browse the repository at this point in the history

  2. Remove extra new lines 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 12, 2022
    Configuration menu
    Copy the full SHA
    cd3e16c View commit details
    Browse the repository at this point in the history

  3. Fix import 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 12, 2022
    Configuration menu
    Copy the full SHA
    0c7dbd9 View commit details
    Browse the repository at this point in the history

  4. Add size for shard routing cache 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 12, 2022
    Configuration menu
    Copy the full SHA
    438fe9e View commit details
    Browse the repository at this point in the history

  5. Invalidate shard routing cache on close 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 12, 2022
    Configuration menu
    Copy the full SHA
    694be4d View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2022

  1. Refactor code 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    9236b8d View commit details
    Browse the repository at this point in the history

  2. Add test for Weighted routing iterator and some refactoring changes 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    93e7587 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/main' into feature/wrr-shard-rou… 

    …ting-core
    Anshu Agarwal committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    a9e30d1 View commit details
    Browse the repository at this point in the history

  4. Update metadata minimal supported version 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    17dc58c View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2022

  1. Add cluster setting for default weight 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 14, 2022
    Configuration menu
    Copy the full SHA
    ed0cc1b View commit details
    Browse the repository at this point in the history

  2. Fix tests due to the change 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 14, 2022
    Configuration menu
    Copy the full SHA
    5a5cb11 View commit details
    Browse the repository at this point in the history

  3. Fix cache concurrency issue 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 14, 2022
    Configuration menu
    Copy the full SHA
    1c33964 View commit details
    Browse the repository at this point in the history

  4. Spotless check fix 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 14, 2022
    Configuration menu
    Copy the full SHA
    f8638f2 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2022

  1. Fix weighted round robin logic case when there is an entity with weig… 

    …ht 0

Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    4016d27 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2022

  1. Changes weight data type to double 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    c98606d View commit details
    Browse the repository at this point in the history

  2. Fix test 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    1bd83f3 View commit details
    Browse the repository at this point in the history

  3. Empty commit 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    8a72dc0 View commit details
    Browse the repository at this point in the history

  4. Empty commit 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    bff61b9 View commit details
    Browse the repository at this point in the history

  5. Fix spotless check 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    9102616 View commit details
    Browse the repository at this point in the history

  6. Create in-memory cache for shard routings 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    a291634 View commit details
    Browse the repository at this point in the history

  7. Fix put operation for weighted shard routings 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    bd6c9e7 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2022

  1. Add tests for shard routing in-memory store 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 17, 2022
    Configuration menu
    Copy the full SHA
    d9368ab View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into feature/wrr-shard-routing-core

    Anshu Agarwal committed Sep 17, 2022
    Configuration menu
    Copy the full SHA
    a3f0290 View commit details
    Browse the repository at this point in the history

  3. Add java docs and some code refactoring 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 17, 2022
    Configuration menu
    Copy the full SHA
    01239bf View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2022

  1. Add null check for discovery nodes and single mutex for weighted shar… 

    …d iterator

Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    dbbb263 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'feature/wrr-shard-routing-core' into feature/wrr-put-api

    Anshu Agarwal committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    785437b View commit details
    Browse the repository at this point in the history

  3. Refactor code 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    f06a039 View commit details
    Browse the repository at this point in the history

  4. Fix tests 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    0a4b829 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/main' into feature/wrr-put-api

    Anshu Agarwal committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    5f451d4 View commit details
    Browse the repository at this point in the history

  6. Refactor code 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    4f349e9 View commit details
    Browse the repository at this point in the history

  7. Remove unwanted changes 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    e59cff2 View commit details
    Browse the repository at this point in the history

  8. Remove unwanted changes for Requests.java 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    dc79fec View commit details
    Browse the repository at this point in the history

  9. Refactore code 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    7671d63 View commit details
    Browse the repository at this point in the history

  10. Add change log 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 19, 2022
    Configuration menu
    Copy the full SHA
    454387d View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2022

  1. Fix test failure 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 20, 2022
    Configuration menu
    Copy the full SHA
    027d73a View commit details
    Browse the repository at this point in the history

  2. Make WeightedRoutingService not to imoplement ClusterStateApplier 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 20, 2022
    Configuration menu
    Copy the full SHA
    19047e6 View commit details
    Browse the repository at this point in the history

  3. Update metadata call 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 20, 2022
    Configuration menu
    Copy the full SHA
    663017f View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2022

  1. Add tests for WeightedRoutingService 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 21, 2022
    Configuration menu
    Copy the full SHA
    70790e9 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2022

  1. Add string formatter 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 22, 2022
    Configuration menu
    Copy the full SHA
    ba87256 View commit details
    Browse the repository at this point in the history

  2. Fix locale in string formatter 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 22, 2022
    Configuration menu
    Copy the full SHA
    4057441 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2022

  1. Refactor code based on review comments 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 23, 2022
    Configuration menu
    Copy the full SHA
    83797f4 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2022

  1. Refactor code 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 26, 2022
    Configuration menu
    Copy the full SHA
    006600c View commit details
    Browse the repository at this point in the history

  2. Refactor code 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 26, 2022
    Configuration menu
    Copy the full SHA
    0240ff0 View commit details
    Browse the repository at this point in the history

  3. Address review comments 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 26, 2022
    Configuration menu
    Copy the full SHA
    7763067 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into feature/wrr-put-api

    @anshu1106
    anshu1106 authored Sep 26, 2022
    Configuration menu
    Copy the full SHA
    3a0b0ff View commit details
    Browse the repository at this point in the history

  5. Address review comments 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 26, 2022
    Configuration menu
    Copy the full SHA
    703d918 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2022

  1. Add explicit count in request validation error message 

    Signed-off-by: Anshu Agarwal <anshukag@amazon.com>
    Anshu Agarwal committed Sep 27, 2022
    Configuration menu
    Copy the full SHA
    f3cf04d View commit details
    Browse the repository at this point in the history