-
Notifications
You must be signed in to change notification settings - Fork 804
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix(cmd bench-omni): build omni-bencher with production profile #7299
Conversation
Signed-off-by: Iulian Barbu <iulian.barbu@parity.io>
Signed-off-by: Iulian Barbu <iulian.barbu@parity.io>
/cmd bench --runtime westend --pallets pallet_balances |
Command "bench --runtime westend --pallets pallet_balances" has started 🚀 See logs here |
Command "bench --runtime westend --pallets pallet_balances" has finished ✅ See logs here |
/cmd bench --runtime westend --pallet pallet_balances |
Command "bench --runtime westend --pallet pallet_balances" has started 🚀 See logs here |
…llet pallet_balances'
Command "bench --runtime westend --pallet pallet_balances" has finished ✅ See logs here Subweight results:
Command output:✅ Successful benchmarks of runtimes/pallets: |
/cmd bench-omni --runtime westend --pallet pallet_balances |
Command "bench-omni --runtime westend --pallet pallet_balances" has started 🚀 See logs here |
… --pallet pallet_balances'
Command "bench-omni --runtime westend --pallet pallet_balances" has finished ✅ See logs here Subweight results:
Command output:✅ Successful benchmarks of runtimes/pallets: |
Signed-off-by: Iulian Barbu <iulian.barbu@parity.io>
Signed-off-by: Iulian Barbu <iulian.barbu@parity.io>
@iulianbarbu if I compare 2 commits b/w each other - i see that bench-omni is still 30% worse as it was before with threshold 2 it shows all of them degraded |
Looks like the commits are from paritytech/polkadot-sdk. Wouldn't the comparisons use the omni-bencher built w/o the prod profile, so the results make sense? In any case, seems like the commits refer to my previous attempts to reproduce your issue on this branch, on this repo, on this org, while my actual fixing/testing happened on paritytech-stg. Fixing master on paritytech is based on the results of the tests from paritytech-stg. |
@iulianbarbu you're right! I didn't think that it's a context of paritytech and this change is still pulling from master |
* master: (58 commits) [pallet-revive] pack exceeding syscall arguments into registers (#7319) cumulus: bump PARENT_SEARCH_DEPTH and add test for 12-core elastic scaling (#6983) xcm: fix for DenyThenTry Barrier (#7169) Migrating polkadot-runtime-common slots benchmarking to v2 (#6614) Add development chain-spec file for minimal/parachain templates for Omni Node compatibility (#6529) `Arc` definition in `TransactionPool` (#7042) [sync] Let new subscribers know about already connected peers (backward-compatible) (#7344) Removed unused dependencies (partial progress) (#7329) Improve debugging by using `#[track_caller]` in system `assert_last_event` and `assert_has_event` (#7142) `set_validation_data` register weight manually, do not use refund when the pre dispatch is zero. (#7327) Fix the link to the chain snapshots (#7330) revive: Fix compilation of `uapi` crate when `unstable-hostfn` is not set (#7318) [pallet-revive] eth-rpc minor fixes (#7325) sync-templates: enable syncing from stable release patches (#7227) Bridges: emulated tests small nits/improvements (#7322) fix(cmd bench-omni): build omni-bencher with production profile (#7299) Nits for collectives-westend XCM benchmarks setup (#7215) bench all weekly - and fix for pallet_multisig lib (#6789) Deprecate ParaBackingState API (#6867) Fix setting the image properly (#7315) ...
Description
This PR builds frame-omni-bencher with
production
profile when calling/cmd bench-omni
to compute benchmarks for pallets.Fix proposed by @bkchr , thanks!
Closes #6797.
Integration
N/A
Review Notes
More info on #6797, and related to how the fix was tested: #6797 (comment).