Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Benchmark] Implements indexer benchmark #2440

Merged
merged 5 commits into from
Aug 15, 2024
Merged

[Benchmark] Implements indexer benchmark #2440

merged 5 commits into from
Aug 15, 2024

Conversation

baichuan3
Copy link
Collaborator

Summary

Finish #2366

  1. Implements indexer benchmark.
  2. Fixup benchmarks dependency on tokio runtime.

Copy link

vercel bot commented Aug 15, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
rooch-portal ✅ Ready (Inspect) Visit Preview 💬 Add feedback Aug 15, 2024 10:06am
1 Skipped Deployment
Name Status Preview Comments Updated (UTC)
rooch ⬜️ Ignored (Inspect) Visit Preview Aug 15, 2024 10:06am

Copy link

github-actions bot commented Aug 15, 2024

Dependency Review

✅ No vulnerabilities or license issues or OpenSSF Scorecard issues found.

OpenSSF Scorecard

PackageVersionScoreDetails

Scanned Manifest Files

@baichuan3
Copy link
Collaborator Author

baichuan3 commented Aug 15, 2024

Indexer write benchmark:

Benchmarking write_object_states/indexer_write/10000
Benchmarking write_object_states/indexer_write/10000
Benchmarking write_object_states/indexer_write/1000000: Collecting 100 samples in estimated 5.4298 s (90
Benchmarking write_object_states/indexer_write/10000
write_object_states/indexer_write/1000000
                        time:   [4.9820 ms 5.2295 ms 5.4758 ms]
                        change: [-4.2140% +1.8781% +9.0716%] (p = 0.59 > 0.05)
                        No change in performance detected.

Indexer read benchmark

Benchmarking read_object_states/indexer_read/1000000: Collecting 100 samples in estimated 49.284 s (100
Benchmarking read_object_states/indexer_read/1000000
read_object_states/indexer_read/1000000
                        time:   [485.53 ms 486.66 ms 487.86 ms]
                        change: [-50.861% -50.709% -50.567%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
  5 (5.00%) high mild

@baichuan3 baichuan3 merged commit c4e39f7 into main Aug 15, 2024
8 checks passed
@baichuan3 baichuan3 deleted the indexer_benchmark branch August 15, 2024 14:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Indexer] Optmize indexer
3 participants