feat: adds benchmarks, performance improvements for segmented log #21

arindas · 2023-07-27T10:34:20Z

Employs BufWriter for tokio and glommio_buffered storage impls to improve performance on small writes
Adds benchmarks for segmented log on different storage implementations with different message size workloads

… region of intererest

…mpls

…am benchmark

…put loop" This reverts commit 5def46f.

…p impl

… writes which are more prevalent

arindas added 19 commits July 7, 2023 12:14

chore: adds stub fib_benchmark to verify criterion bench harness

0bcfe01

feat: prepare for commit_log append benchmark

b76a31f

bench: added in mem storage benchmark

82a3143

feat: use iter_custom for to avoid including creation time and drop

1c19a62

feat: adds new benchmarks with different size

42d160c

feat: adds tokio segmented_log append benchmark

f1b23c4

feat: added black box to prevent optimization from optimizing out our…

9c18631

… region of intererest

feat: tokio use BufWriter over TokioFile

d3e38a3

feat: adds segmented log read stream benchmark

1a5296d

feat: adds pprof flamgraph profiler

914c231

chore: remove libtest bench harness from binaries

1994d67

feat: adds benchmark for glommio dma file and buffered file storage i…

37b180b

…mpls

feat: adds glommio dma file and buferred impls for segmented log stre…

d6a4837

…am benchmark

fix: removes bench storage directories at the end of bench input loop

5def46f

Revert "fix: removes bench storage directories at the end of bench in…

92197a9

…put loop" This reverts commit 5def46f.

feat: explicitly remove segmented log files instead of relying on dro…

cde5d80

…p impl

feat: employs BufWriter with BufferedFile to improve perform on small…

e9d04ac

… writes which are more prevalent

feat: invokes rlimit to set NOFILE limit during bench; adds ci bench cmp

9cbfb4a

feat: corrected ci workflow

b3d3979

arindas merged commit 117189f into dev/1 Jul 27, 2023

arindas deleted the benchmark/segmented-log branch July 27, 2023 10:39

Provide feedback