Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Write a simulator to test different storage formats and cleaning strategies #402

Closed
hlinnaka opened this issue Aug 9, 2021 · 3 comments
Closed

Write a simulator to test different storage formats and cleaning strategies #402

hlinnaka opened this issue Aug 9, 2021 · 3 comments
Labels
c/storage/pageserver Component: storage: pageserver

Comments

@hlinnaka
Copy link
Contributor

hlinnaka commented Aug 9, 2021

Something like the simulator described here: https://arxiv.org/pdf/2005.00044.pdf.

Per discussion at: https://discord.com/channels/869525774699462656/869526396878323733/873033240271810560
@hlinnaka hlinnaka assigned hlinnaka and unassigned hlinnaka Aug 9, 2021
@petergeoghegan petergeoghegan self-assigned this Aug 11, 2021
@kelvich kelvich added the c/storage/pageserver Component: storage: pageserver label Dec 22, 2021
@shanyp
Copy link
Contributor

shanyp commented Jul 16, 2023

@skyzh just for FYI
@hlinnaka any further work needed here ?

@skyzh
Copy link
Member

skyzh commented Jul 21, 2023

the thing I have in the compaction PoC is a compaction simulator. #4539 As tiered compaction make decisions purely based on sizes, we can estimate write / read / space amplification easily with such compaction simulators.

@arpad-m
Copy link
Member

arpad-m commented Mar 5, 2024

PR #6830 / #5234 has added a simulator, can this be closed now?

@skyzh skyzh closed this as completed Mar 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
c/storage/pageserver Component: storage: pageserver
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
6 participants
@hlinnaka @kelvich @petergeoghegan @shanyp @skyzh @arpad-m