Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dag db-exporter export range and apply #4131

Merged
merged 9 commits into from
Jun 12, 2024
Merged

Dag db-exporter export range and apply #4131

merged 9 commits into from
Jun 12, 2024

Conversation

nkysg
Copy link
Collaborator

@nkysg nkysg commented Jun 6, 2024

Pull request type

Please check the type of change your PR introduces:

  • Bugfix
  • Feature
  • Code style update (formatting, renaming)
  • Refactoring (no functional changes, no api changes)
  • Build related changes
  • Documentation content changes
  • Other (please describe):

What is the current behavior?

Issue Number: N/A

What is the new behavior?

Other information

@nkysg nkysg requested a review from jolestar as a code owner June 6, 2024 16:43
@nkysg nkysg requested review from sanlee42, simonjiao, welbon and jackzhhuang and removed request for jolestar June 6, 2024 16:43
Copy link

github-actions bot commented Jun 6, 2024

Benchmark for 5468c29

Click to view benchmark
Test Base PR %
accumulator_append 985.0±256.96µs 1068.1±269.60µs +8.44%
block_apply/block_apply_10 458.9±73.92ms 454.3±68.35ms -1.00%
block_apply/block_apply_1000 54.6±3.97s 50.7±2.46s -7.14%
get_with_proof/db_store 56.9±13.67µs 56.4±12.98µs -0.88%
get_with_proof/mem_store 48.5±9.68µs 47.3±11.25µs -2.47%
put_and_commit/db_store/1 134.3±17.72µs 160.0±37.44µs +19.14%
put_and_commit/db_store/10 1422.2±298.80µs 1838.7±279.93µs +29.29%
put_and_commit/db_store/100 16.8±0.99ms 13.4±2.81ms -20.24%
put_and_commit/db_store/5 732.8±170.03µs 948.0±77.70µs +29.37%
put_and_commit/db_store/50 6.7±1.40ms 5.9±1.04ms -11.94%
put_and_commit/mem_store/1 82.3±16.51µs 97.8±21.34µs +18.83%
put_and_commit/mem_store/10 920.6±213.26µs 992.9±224.60µs +7.85%
put_and_commit/mem_store/100 8.9±1.80ms 8.4±2.06ms -5.62%
put_and_commit/mem_store/5 474.7±114.24µs 579.7±80.11µs +22.12%
put_and_commit/mem_store/50 4.7±1.06ms 4.1±0.91ms -12.77%
query_block/query_block_in(10)_times(100) 6.4±1.23ms 6.4±1.48ms 0.00%
query_block/query_block_in(10)_times(1000) 65.2±8.86ms 65.5±7.81ms +0.46%
query_block/query_block_in(10)_times(10000) 686.7±195.26ms 670.0±119.49ms -2.43%
query_block/query_block_in(1000)_times(100) 1816.4±327.88µs 1526.2±229.06µs -15.98%
query_block/query_block_in(1000)_times(1000) 19.4±2.55ms 14.8±2.95ms -23.71%
query_block/query_block_in(1000)_times(10000) 164.7±44.67ms 120.7±5.16ms -26.72%
storage_transaction 1582.5±652.80µs 1444.8±726.58µs -8.70%
vm/transaction_execution/1 542.2±111.26ms 517.7±61.08ms -4.52%
vm/transaction_execution/10 152.8±10.87ms 169.9±10.90ms +11.19%
vm/transaction_execution/20 145.7±12.78ms 157.7±12.52ms +8.24%
vm/transaction_execution/5 215.5±25.45ms 190.1±15.36ms -11.79%
vm/transaction_execution/50 184.4±14.72ms 213.2±13.65ms +15.62%

Copy link

github-actions bot commented Jun 7, 2024

Benchmark for 2b00128

Click to view benchmark
Test Base PR %
accumulator_append 893.7±206.77µs 1008.4±234.57µs +12.83%
block_apply/block_apply_10 419.9±49.20ms 434.7±57.51ms +3.52%
block_apply/block_apply_1000 43.7±2.77s 45.1±2.13s +3.20%
get_with_proof/db_store 47.0±2.45µs 63.5±15.64µs +35.11%
get_with_proof/mem_store 38.6±2.60µs 42.4±8.70µs +9.84%
put_and_commit/db_store/1 122.7±5.97µs 129.7±24.43µs +5.70%
put_and_commit/db_store/10 1351.3±267.99µs 1083.4±75.77µs -19.83%
put_and_commit/db_store/100 11.8±2.27ms 13.2±2.61ms +11.86%
put_and_commit/db_store/5 578.3±102.75µs 590.8±93.84µs +2.16%
put_and_commit/db_store/50 6.0±1.22ms 6.3±1.10ms +5.00%
put_and_commit/mem_store/1 73.6±8.31µs 75.7±9.05µs +2.85%
put_and_commit/mem_store/10 696.8±71.20µs 716.5±93.09µs +2.83%
put_and_commit/mem_store/100 7.1±0.91ms 8.0±1.95ms +12.68%
put_and_commit/mem_store/5 362.2±52.67µs 423.3±122.66µs +16.87%
put_and_commit/mem_store/50 3.6±0.38ms 3.7±0.75ms +2.78%
query_block/query_block_in(10)_times(100) 5.0±0.35ms 4.9±0.56ms -2.00%
query_block/query_block_in(10)_times(1000) 54.6±10.39ms 57.2±12.25ms +4.76%
query_block/query_block_in(10)_times(10000) 498.8±64.61ms 540.0±66.60ms +8.26%
query_block/query_block_in(1000)_times(100) 1391.2±137.79µs 1947.8±338.77µs +40.01%
query_block/query_block_in(1000)_times(1000) 13.8±2.13ms 15.6±4.69ms +13.04%
query_block/query_block_in(1000)_times(10000) 141.4±32.86ms 135.4±14.21ms -4.24%
storage_transaction 1098.5±393.08µs 1154.0±412.97µs +5.05%
vm/transaction_execution/1 456.9±46.51ms 468.8±60.48ms +2.60%
vm/transaction_execution/10 135.6±4.69ms 159.6±13.58ms +17.70%
vm/transaction_execution/20 133.3±14.28ms 142.5±19.39ms +6.90%
vm/transaction_execution/5 176.1±10.92ms 182.2±11.47ms +3.46%
vm/transaction_execution/50 145.2±8.41ms 162.4±13.99ms +11.85%

cmd/db-exporter/src/main.rs Outdated Show resolved Hide resolved
Copy link

Benchmark for 1889d01

Click to view benchmark
Test Base PR %
accumulator_append 996.8±227.89µs 974.1±205.60µs -2.28%
block_apply/block_apply_10 408.2±54.87ms 411.4±45.21ms +0.78%
block_apply/block_apply_1000 46.3±1.54s 45.8±2.89s -1.08%
get_with_proof/db_store 62.1±14.35µs 52.6±11.66µs -15.30%
get_with_proof/mem_store 43.9±9.76µs 41.8±8.69µs -4.78%
put_and_commit/db_store/1 135.7±22.97µs 149.4±31.70µs +10.10%
put_and_commit/db_store/10 1178.0±138.78µs 1288.1±231.01µs +9.35%
put_and_commit/db_store/100 12.1±1.99ms 14.6±2.67ms +20.66%
put_and_commit/db_store/5 739.9±141.08µs 617.6±112.26µs -16.53%
put_and_commit/db_store/50 5.6±0.76ms 5.8±0.97ms +3.57%
put_and_commit/mem_store/1 74.1±6.87µs 102.0±19.30µs +37.65%
put_and_commit/mem_store/10 805.1±97.37µs 921.2±198.37µs +14.42%
put_and_commit/mem_store/100 6.8±0.50ms 9.3±2.24ms +36.76%
put_and_commit/mem_store/5 445.0±136.31µs 389.8±84.71µs -12.40%
put_and_commit/mem_store/50 4.0±1.06ms 4.2±1.07ms +5.00%
query_block/query_block_in(10)_times(100) 4.8±0.44ms 5.5±0.91ms +14.58%
query_block/query_block_in(10)_times(1000) 50.6±5.79ms 59.5±9.10ms +17.59%
query_block/query_block_in(10)_times(10000) 489.6±33.56ms 535.5±58.99ms +9.37%
query_block/query_block_in(1000)_times(100) 1227.3±93.73µs 1323.3±116.25µs +7.82%
query_block/query_block_in(1000)_times(1000) 12.8±0.99ms 12.2±0.76ms -4.69%
query_block/query_block_in(1000)_times(10000) 133.0±14.96ms 129.5±12.13ms -2.63%
storage_transaction 1217.5±453.59µs 1378.6±440.51µs +13.23%
vm/transaction_execution/1 502.3±45.53ms 507.3±66.41ms +1.00%
vm/transaction_execution/10 161.9±7.20ms 164.1±12.13ms +1.36%
vm/transaction_execution/20 151.1±10.90ms 173.6±17.03ms +14.89%
vm/transaction_execution/5 209.7±17.70ms 190.6±19.16ms -9.11%
vm/transaction_execution/50 179.0±20.72ms 171.6±12.82ms -4.13%

@simonjiao simonjiao merged commit b8dcb96 into dag-master Jun 12, 2024
4 of 5 checks passed
@simonjiao simonjiao deleted the dag-dbexporter branch June 12, 2024 10:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants