Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tablet splitting #1004

Closed
mbautin opened this issue Mar 14, 2019 · 0 comments
Closed

Tablet splitting #1004

mbautin opened this issue Mar 14, 2019 · 0 comments
Assignees
Labels
area/docdb YugabyteDB core features kind/new-feature This is a request for a completely new feature priority/medium Medium priority issue roadmap-tracking-issue This issue tracks a major roadmap item, and usually appears in the roadmap list.

Comments

@mbautin
Copy link
Collaborator

mbautin commented Mar 14, 2019

Jira Link: DB-735
Enables dynamically re-sharding the data in a cluster. This is accomplished by allowing each shard (called a tablet) in the cluster to split into two or more tablets at runtime, transparent to the end user.

Prerequisites

✅ Design Doc: automatic re-sharding of data with tablet splitting

Phase 1 - Basic functionality

#1458 Splitting DocDB data files
#1459 Support splitting on the nodes (YB-TServers)
#1460 Refresh tablets seamlessly across nodes
#1461 Drive tablet splitting from master
✅ Ability to manually split tablets (hash and range)

Phase 2 - Automatic splitting

#1461 Mechanism to initiate tablet splitting automatically (from YB-Master leader)
✅ Auto-splitting for range-partitioned tables
✅ Auto-splitting for hash-partitioned tables
#1462 Size-based tablet splitting strategy
#6101 Policy on when to stop splitting
#4929 Cleanup parent tablets from disk after split

Phase 3 - Advanced splitting strategies

#5523 #6424 Compaction improvements to limit the disk utilization
⬜️ #1463 Load-based tablet splitting strategy
⬜️ #5854 Handle YCQL/YSQL retries internally so we avoid application errors
⬜️ #5373 Integration with 2DC
⬜️ #6667 Limit the number of outstanding splits from the master

Analytics

@rkarthik007 rkarthik007 added the kind/new-feature This is a request for a completely new feature label Mar 15, 2019
@rkarthik007 rkarthik007 added this to To Do in YBase features via automation Mar 15, 2019
@bmatican bmatican moved this from To Do to In progress in YBase features May 28, 2019
@bmatican bmatican added this to the v2.1 milestone Sep 1, 2019
@bmatican bmatican added the area/docdb YugabyteDB core features label Mar 31, 2020
@rkarthik007 rkarthik007 removed this from the v2.1 milestone Jun 5, 2020
@ttyusupov ttyusupov added this to To do in Tablet splitting via automation Jun 23, 2020
@ttyusupov ttyusupov moved this from To do to In progress in Tablet splitting Jun 23, 2020
@rkarthik007 rkarthik007 added the roadmap-tracking-issue This issue tracks a major roadmap item, and usually appears in the roadmap list. label Jul 24, 2020
@yugabyte-ci yugabyte-ci added the priority/medium Medium priority issue label Jun 8, 2022
YBase features automation moved this from In progress to Done Jul 28, 2022
Tablet splitting automation moved this from In progress to Done Jul 28, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/docdb YugabyteDB core features kind/new-feature This is a request for a completely new feature priority/medium Medium priority issue roadmap-tracking-issue This issue tracks a major roadmap item, and usually appears in the roadmap list.
Projects
Development

No branches or pull requests

6 participants
@bmatican @mbautin @ttyusupov @rkarthik007 @yugabyte-ci and others