Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] [FLASH-319/343/344] PageSotrage MVCC && Snapshot read #138

Closed
wants to merge 36 commits into from
Closed

[WIP] [FLASH-319/343/344] PageSotrage MVCC && Snapshot read #138

wants to merge 36 commits into from

Conversation

JaySon-Huang
Copy link
Contributor

@JaySon-Huang JaySon-Huang commented Jul 25, 2019 •
edited
Loading

Snapshot read:

  • acquire a snapshot through PageStorage.getSnapshot()
  • set snapshot parameter when do read/traverse/traversePageEntries
  • if snapshot is nullptr(by default), PageStorage will generate a snapshot first

@JaySon-Huang
MVCC on PageMap, All previse tests passed. TODO: refactor on read_mut…
62197f1 
…ex on PageStorage
@JaySon-Huang
PageStorage gc: only delete file that are not used by any version
79235e7
@JaySon-Huang
fix bug under multi-threads;
7bcea70 
remove unused code && format codes
@JaySon-Huang
1. support snapshot read
547a82e 
2. standalone VersionSet/MultiVersionCountable template
@JaySon-Huang
add test for PageStorage snapshot read
5294020
@JaySon-Huang
use typed test
ddbece0
@JaySon-Huang
Bug fix: Add RefPage to non exist Page
2a8b6a9
@JaySon-Huang
fix bug
5d8fa24
@JaySon-Huang
1. Apply merge delta if no read ref
b342dcb 
2. Apply generate new delta if has read ref
3. Delta merged when snapshot released
4. Add simple restore test
5. Use template and constexpr instead of copying codes in PageEntryMap
@JaySon-Huang
Delta merged when view is finished
1d8bf59
@JaySon-Huang
1. VersionDeltaSet: add snapshots for snapshot linked-list, so that g…
af3b020 
…c can collect valid PageFiles

2. fix some bugs
@JaySon-Huang
do compact on delta -> base
385a781
@JaySon-Huang
rebase after do compact on delta
4c62515
@JaySon-Huang
fix bugs
2e87e20
@JaySon-Huang
avoid duplicted codes
852534f
@JaySon-Huang
1. new find API
5445a0a 
2. all tests passed
@JaySon-Huang
1. remove legacy API
2ca8954 
2. remove duplicated codes
@JaySon-Huang
reformat
4b0de77
@JaySon-Huang
apply inplace if there are no readers
63334e2
@JaySon-Huang
fix bug of applying edits
8c7c682
@JaySon-Huang
fix bug of gc apply
330c687
@JaySon-Huang
fix bug of merging PageEntryMap
ae34921
@JaySon-Huang
fix bug of invalid ref page
2dca931
@JaySon-Huang
fix bug:
3c771c0 
1. listAllLiveFiles
2. double compaction on same version
@JaySon-Huang
fixbug
a54342a
@JaySon-Huang
tmp
0df4438
@JaySon-Huang
split PageEntryMapView to single cpp file
f09ec26
@JaySon-Huang
minor fix
92d0aef
@JaySon-Huang
1. Avoid visit same version multiple time in PageEntryMapDeltaVersion…
7ac88d7 
…Set::listAllLiveFiles

2. use template to reduce duplicated code for gcApply
@JaySon-Huang
todo mark
2d13ba5
@CalvinNeo CalvinNeo mentioned this pull request Nov 7, 2024
Closed
12 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@JaySon-Huang