Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement the toolkit for managing Migrations. #55661

Closed
Tracked by #56522
YuJuncen opened this issue Aug 26, 2024 · 1 comment · Fixed by #55665
Closed
Tracked by #56522

Implement the toolkit for managing Migrations. #55661

YuJuncen opened this issue Aug 26, 2024 · 1 comment · Fixed by #55665
Labels
type/enhancement The issue or PR belongs to an enhancement.

Comments

@YuJuncen
Copy link
Contributor

Enhancement

We have designed the migration system for compacting log backup. Generally, every modifications over the "stabilized" storage must be done by appending a "migration".

     +-Modifications over those files                 
     | Must be done by Appending a migration.         
     |                                                
+----|--------------+-------------+                   
| stabilized        | Appending   |                   
|-------------------|-------------+                   
|                    \                                
 \                   |                                
 |Truncated TS        \Resolved TS                    

Migrations are idempotent batch modifications (adding a compaction, delete a file, etc..) to the backup files.
You may check the protocol buffer message Migration for more details.
Idempontence is important for migrations, as they may be executed multi times due to retry or racing.

@YuJuncen YuJuncen added the type/enhancement The issue or PR belongs to an enhancement. label Aug 26, 2024
@YuJuncen
Copy link
Contributor Author

We need to implement the toolkit for the Migration storage.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/enhancement The issue or PR belongs to an enhancement.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant