Skip to content
This repository has been archived by the owner on Nov 15, 2023. It is now read-only.

[DONT MERGE] Test Benchmark Bot Performance #9332

Closed
wants to merge 22 commits into from

Conversation

shawntabrizi
Copy link
Member

@shawntabrizi shawntabrizi commented Jul 13, 2021

We noticed the benchmark bot giving slower results than we would like. This PR will allow us to test the benchmark bot performance.

Keep this a draft to minimize CI usage

[skip ci]

@shawntabrizi
Copy link
Member Author

/benchmark runtime pallet pallet_balances

@parity-benchapp
Copy link

parity-benchapp bot commented Jul 13, 2021

Benchmark Runtime Pallet for branch "shawntabrizi-test-benchmark-bot" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results
Pallet: "pallet_balances", Extrinsic: "transfer", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=     93.2
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=     93.2
              µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "transfer_keep_alive", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    68.09
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    68.09
              µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "set_balance_creating", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    37.46
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    37.46
              µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "set_balance_killing", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=     45.3
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=     45.3
              µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "force_transfer", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    92.05
              µs

Reads = 2
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    92.05
              µs

Reads = 2
Writes = 2
Pallet: "pallet_balances", Extrinsic: "transfer_all", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    85.01
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    85.01
              µs

Reads = 1
Writes = 1

@github-actions github-actions bot added the A3-in_progress Pull request is in progress. No review needed at this stage. label Jul 13, 2021
…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs
@shawntabrizi
Copy link
Member Author

/benchmark runtime pallet pallet_balances

@parity-benchapp
Copy link

parity-benchapp bot commented Jul 13, 2021

Finished benchmark for branch: shawntabrizi-test-benchmark-bot

Benchmark: Benchmark Runtime Pallet

cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results

Pallet: "pallet_balances", Extrinsic: "transfer", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 76.13
µs

Reads = 1
Writes = 1
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 76.13
µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "transfer_keep_alive", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 56.12
µs

Reads = 1
Writes = 1
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 56.12
µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "set_balance_creating", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 30.81
µs

Reads = 1
Writes = 1
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 30.81
µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "set_balance_killing", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 37.48
µs

Reads = 1
Writes = 1
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 37.48
µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "force_transfer", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 74.68
µs

Reads = 2
Writes = 2
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 74.68
µs

Reads = 2
Writes = 2
Pallet: "pallet_balances", Extrinsic: "transfer_all", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 69.69
µs

Reads = 1
Writes = 1
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 69.69
µs

Reads = 1
Writes = 1

@parity-benchapp
Copy link

parity-benchapp bot commented Jul 13, 2021

Benchmark Runtime Pallet for branch "shawntabrizi-test-benchmark-bot" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results
Pallet: "pallet_balances", Extrinsic: "transfer", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    91.27
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    91.27
              µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "transfer_keep_alive", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    67.58
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    67.58
              µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "set_balance_creating", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    37.75
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    37.75
              µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "set_balance_killing", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    45.33
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    45.33
              µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "force_transfer", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    90.65
              µs

Reads = 2
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    90.65
              µs

Reads = 2
Writes = 2
Pallet: "pallet_balances", Extrinsic: "transfer_all", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    82.96
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    82.96
              µs

Reads = 1
Writes = 1

…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs
@shawntabrizi
Copy link
Member Author

/benchmark runtime pallet pallet_balances

@parity-benchapp
Copy link

parity-benchapp bot commented Jul 13, 2021

Finished benchmark for branch: shawntabrizi-test-benchmark-bot

Benchmark: Benchmark Runtime Pallet

cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results

Pallet: "pallet_balances", Extrinsic: "transfer", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 77.26
µs

Reads = 1
Writes = 1
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 77.26
µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "transfer_keep_alive", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 57.27
µs

Reads = 1
Writes = 1
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 57.27
µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "set_balance_creating", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 31.2
µs

Reads = 1
Writes = 1
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 31.2
µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "set_balance_killing", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 37.73
µs

Reads = 1
Writes = 1
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 37.73
µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "force_transfer", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 76.57
µs

Reads = 2
Writes = 2
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 76.57
µs

Reads = 2
Writes = 2
Pallet: "pallet_balances", Extrinsic: "transfer_all", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 70.76
µs

Reads = 1
Writes = 1
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 70.76
µs

Reads = 1
Writes = 1

…/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs
@shawntabrizi
Copy link
Member Author

/benchmark runtime pallet pallet_balances

@parity-benchapp
Copy link

parity-benchapp bot commented Jul 13, 2021

Finished benchmark for branch: shawntabrizi-test-benchmark-bot

Benchmark: Benchmark Runtime Pallet

cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results

Pallet: "pallet_balances", Extrinsic: "transfer", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 75.2
µs

Reads = 1
Writes = 1
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 75.2
µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "transfer_keep_alive", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 55.83
µs

Reads = 1
Writes = 1
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 55.83
µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "set_balance_creating", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 30.47
µs

Reads = 1
Writes = 1
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 30.47
µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "set_balance_killing", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 36.56
µs

Reads = 1
Writes = 1
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 36.56
µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "force_transfer", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 74.51
µs

Reads = 2
Writes = 2
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 74.51
µs

Reads = 2
Writes = 2
Pallet: "pallet_balances", Extrinsic: "transfer_all", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 68.89
µs

Reads = 1
Writes = 1
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 68.89
µs

Reads = 1
Writes = 1

@shawntabrizi
Copy link
Member Author

/benchmark runtime pallet pallet_treasury

…/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs
@parity-benchapp
Copy link

parity-benchapp bot commented Jul 13, 2021

Finished benchmark for branch: shawntabrizi-test-benchmark-bot

Benchmark: Benchmark Runtime Pallet

cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results

Pallet: "pallet_treasury", Extrinsic: "propose_spend", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 43.04
µs

Reads = 1
Writes = 2
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 43.04
µs

Reads = 1
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "reject_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 39.73
µs

Reads = 2
Writes = 2
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 39.73
µs

Reads = 2
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "approve_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 13.92
+ p 0.141
µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
p mean µs sigma µs %
0 11.61 0.081 0.6%
1 12.65 0.094 0.7%
2 12.8 0.08 0.6%
3 13.31 0.064 0.4%
4 13.45 0.041 0.3%
5 13.78 0.042 0.3%
6 14.66 0.053 0.3%
7 14.44 0.056 0.3%
8 14.66 0.054 0.3%
9 15.15 0.061 0.4%
10 14.76 0.036 0.2%
11 15.43 0.058 0.3%
12 15.13 0.076 0.5%
13 15.61 0.063 0.4%
14 15.54 0.071 0.4%
15 15.81 0.075 0.4%
16 16.11 0.035 0.2%
17 15.91 0.034 0.2%
18 16.41 0.055 0.3%
19 16.71 0.055 0.3%
20 16.81 0.082 0.4%
21 17.13 0.068 0.3%
22 17.4 0.072 0.4%
23 17.54 0.053 0.3%
24 16.93 0.123 0.7%
25 17.72 0.061 0.3%
26 17.77 0.049 0.2%
27 17.78 0.062 0.3%
28 18.21 0.082 0.4%
29 18.26 0.098 0.5%
30 18.45 0.082 0.4%
31 18.52 0.054 0.2%
32 18.92 0.068 0.3%
33 19.01 0.08 0.4%
34 19.21 0.118 0.6%
35 19.26 0.071 0.3%
36 18.85 0.036 0.1%
37 19.37 0.114 0.5%
38 19.18 0.089 0.4%
39 19.77 0.104 0.5%
40 20.02 0.07 0.3%
41 20.06 0.083 0.4%
42 20.04 0.065 0.3%
43 20.52 0.122 0.5%
44 20.45 0.05 0.2%
45 20.49 0.103 0.5%
46 20.61 0.043 0.2%
47 20.79 0.131 0.6%
48 21.24 0.066 0.3%
49 21.23 0.099 0.4%
50 21.73 0.085 0.3%
51 21.9 0.092 0.4%
52 21.17 0.135 0.6%
53 21.45 0.075 0.3%
54 21.83 0.169 0.7%
55 22 0.103 0.4%
56 21.82 0.145 0.6%
57 22.14 0.037 0.1%
58 22.25 0.151 0.6%
59 22.55 0.153 0.6%
60 22.51 0.201 0.8%
61 22.75 0.155 0.6%
62 22.73 0.1 0.4%
63 23.07 0.133 0.5%
64 23.08 0.11 0.4%
65 23.31 0.13 0.5%
66 23.63 0.089 0.3%
67 23.57 0.058 0.2%
68 23.67 0.161 0.6%
69 23.68 0.06 0.2%
70 23.64 0.076 0.3%
71 24.24 0.15 0.6%
72 24.38 0.098 0.4%
73 24.02 0.086 0.3%
74 24.48 0.122 0.4%
75 24.25 0.11 0.4%
76 24.42 0.157 0.6%
77 24.57 0.118 0.4%
78 24.63 0.089 0.3%
79 24.84 0.076 0.3%
80 25.17 0.105 0.4%
81 25.62 0.073 0.2%
82 25.71 0.142 0.5%
83 25.34 0.075 0.2%
84 25.84 0.074 0.2%
85 25.66 0.148 0.5%
86 26.39 0.159 0.6%
87 25.83 0.171 0.6%
88 26.27 0.141 0.5%
89 26.07 0.1 0.3%
90 26.44 0.129 0.4%
91 26.62 0.087 0.3%
92 26.2 0.104 0.3%
93 26.39 0.149 0.5%
94 26.72 0.161 0.6%
95 26.96 0.138 0.5%
96 27.31 0.15 0.5%
97 26.98 0.111 0.4%
98 27.39 0.131 0.4%
99 27.12 0.116 0.4%

Quality and confidence:
param error
p 0

Model:
Time ~= 13.76
+ p 0.143
µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Pallet: "pallet_treasury", Extrinsic: "on_initialize_proposals", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 55.61
+ p 61.47
µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
p mean µs sigma µs %
0 63.02 0.162 0.2%
2 188.6 0.321 0.1%
4 310.3 0.687 0.2%
6 429.7 0.473 0.1%
8 555.7 1.239 0.2%
10 677.3 1.24 0.1%
12 794.7 1.086 0.1%
14 915.1 1.884 0.2%
16 1040 2.032 0.1%
18 1163 3.66 0.3%
20 1283 2.235 0.1%
22 1405 2.666 0.1%
24 1525 1.657 0.1%
26 1643 2.737 0.1%
28 1770 2.949 0.1%
30 1885 2.345 0.1%
32 2021 9.826 0.4%
34 2138 4.468 0.2%
36 2263 9.205 0.4%
38 2390 4.331 0.1%
40 2507 4.147 0.1%
42 2631 5.976 0.2%
44 2758 7.154 0.2%
46 2867 7.399 0.2%
48 2991 5.788 0.1%
50 3125 7.511 0.2%
52 3236 3.747 0.1%
54 3360 5.93 0.1%
56 3479 7.025 0.2%
58 3602 7.674 0.2%
60 3717 4.623 0.1%
62 3841 6.02 0.1%
64 3979 5.945 0.1%
66 4100 6.748 0.1%
68 4222 13.99 0.3%
70 4345 6.439 0.1%
72 4487 2.212 0.0%
74 4610 6.736 0.1%
76 4738 10.17 0.2%
78 4848 7.785 0.1%
80 4972 12.95 0.2%
82 5103 10.93 0.2%
84 5227 7.192 0.1%
86 5340 6.599 0.1%
88 5495 6.751 0.1%
90 5593 8.924 0.1%
92 5739 8.795 0.1%
94 5852 10.76 0.1%
96 5984 11.74 0.1%
98 6093 13.19 0.2%
100 6224 13.26 0.2%

Quality and confidence:
param error
p 0.021

Model:
Time ~= 49.58
+ p 61.57
µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)

…/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs
@joao-paulo-parity
Copy link
Contributor

joao-paulo-parity commented Jul 13, 2021

/benchmark runtime pallet pallet_treasury

paritytech/bench-bot@3373401

@parity-benchapp
Copy link

parity-benchapp bot commented Jul 13, 2021

Benchmark Runtime Pallet for branch "shawntabrizi-test-benchmark-bot" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results
Pallet: "pallet_treasury", Extrinsic: "propose_spend", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    52.02
              µs

Reads = 1
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    52.02
              µs

Reads = 1
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "reject_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=     48.4
              µs

Reads = 2
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=     48.4
              µs

Reads = 2
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "approve_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=     16.7
    + p    0.144
              µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    p   mean µs  sigma µs       %
    0     13.88     0.055    0.3%
    1     14.67     0.094    0.6%
    2     15.04      0.03    0.1%
    3     15.64      0.07    0.4%
    4     15.78     0.049    0.3%
    5     16.18     0.063    0.3%
    6     17.04     0.063    0.3%
    7      16.5     0.045    0.2%
    8     16.86     0.101    0.5%
    9     17.65      0.05    0.2%
   10     17.29     0.027    0.1%
   11     17.85      0.04    0.2%
   12     17.41     0.046    0.2%
   13     18.27     0.075    0.4%
   14     17.99     0.041    0.2%
   15     18.18     0.082    0.4%
   16     18.92     0.067    0.3%
   17     18.43     0.054    0.2%
   18     19.17     0.065    0.3%
   19     19.55     0.068    0.3%
   20     19.34     0.064    0.3%
   21     20.16     0.093    0.4%
   22     20.17     0.075    0.3%
   23     20.53     0.075    0.3%
   24     19.41     0.074    0.3%
   25     20.34     0.061    0.2%
   26     20.54     0.078    0.3%
   27     20.81     0.148    0.7%
   28     21.08     0.184    0.8%
   29     21.14     0.119    0.5%
   30     21.59      0.07    0.3%
   31     21.82     0.093    0.4%
   32     21.55     0.133    0.6%
   33     21.55      0.15    0.6%
   34     22.33     0.131    0.5%
   35     22.01      0.14    0.6%
   36     21.99     0.113    0.5%
   37     22.69      0.14    0.6%
   38     22.19     0.099    0.4%
   39      22.8     0.118    0.5%
   40     23.08     0.165    0.7%
   41     23.31     0.115    0.4%
   42     23.15     0.139    0.6%
   43     23.64     0.102    0.4%
   44     22.53     0.887    3.9%
   45     22.91       0.8    3.4%
   46     23.06     0.905    3.9%
   47     22.93     1.108    4.8%
   48     22.72     1.069    4.7%
   49     24.38     0.189    0.7%
   50     23.32     1.666    7.1%
   51      23.1     2.323   10.0%
   52      23.2     1.851    7.9%
   53     21.57     2.053    9.5%
   54     23.89     1.692    7.0%
   55      25.5     0.216    0.8%
   56     25.41     0.131    0.5%
   57     25.62     0.161    0.6%
   58     25.28     0.091    0.3%
   59     26.02     0.238    0.9%
   60     25.41       0.3    1.1%
   61        26     0.137    0.5%
   62     26.04     0.191    0.7%
   63     26.56     0.079    0.2%
   64     26.54     0.125    0.4%
   65     26.84     0.197    0.7%
   66     27.33     0.113    0.4%
   67     26.36     1.283    4.8%
   68     25.55     1.748    6.8%
   69     19.82     0.159    0.8%
   70     19.82     0.099    0.4%
   71     20.71      0.36    1.7%
   72     20.41      0.12    0.5%
   73     20.11     0.205    1.0%
   74     21.07     1.163    5.5%
   75     24.64     3.216   13.0%
   76     27.74     0.147    0.5%
   77     28.23     0.189    0.6%
   78     28.19     0.191    0.6%
   79     28.43     0.164    0.5%
   80     29.12     0.074    0.2%
   81     29.44     0.086    0.2%
   82     29.61     0.064    0.2%
   83      29.3     0.192    0.6%
   84     29.63     0.156    0.5%
   85     29.54     0.214    0.7%
   86     30.72     0.111    0.3%
   87     27.77      2.06    7.4%
   88     26.73     1.944    7.2%
   89     27.45     2.458    8.9%
   90     23.04     1.774    7.6%
   91     22.73     2.005    8.8%
   92     20.39     0.061    0.2%
   93     20.33     0.201    0.9%
   94     20.26     0.111    0.5%
   95     20.33      0.14    0.6%
   96     20.93     0.143    0.6%
   97     20.44     0.124    0.6%
   98     20.67     0.101    0.4%
   99     20.67      0.23    1.1%

Quality and confidence:
param     error
p         0.003

Model:
Time ~=    17.83
    + p    0.092
              µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Pallet: "pallet_treasury", Extrinsic: "on_initialize_proposals", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    60.91
    + p    75.27
              µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    p   mean µs  sigma µs       %
    0     77.76     0.167    0.2%
    2     225.1      0.23    0.1%
    4     370.7     0.928    0.2%
    6     516.5     0.726    0.1%
    8       672     5.767    0.8%
   10     813.6     1.805    0.2%
   12     959.9     2.458    0.2%
   14      1109     0.838    0.0%
   16      1264     11.35    0.8%
   18      1407     1.827    0.1%
   20      1563     12.13    0.7%
   22      1699     10.93    0.6%
   24      1847     2.322    0.1%
   26      2005     6.571    0.3%
   28      2156     16.83    0.7%
   30      2303     14.24    0.6%
   32      2452      16.1    0.6%
   34      2609     16.96    0.6%
   36      2758     16.36    0.5%
   38      2913      14.1    0.4%
   40      3065     10.61    0.3%
   42      3226     15.75    0.4%
   44      3360     11.24    0.3%
   46      3505     12.47    0.3%
   48      3670     7.924    0.2%
   50      3801     14.66    0.3%
   52      3991     5.174    0.1%
   54      4087     12.36    0.3%
   56      4241     7.642    0.1%
   58      4414     9.583    0.2%
   60      4550     8.442    0.1%
   62      4700     11.28    0.2%
   64      4881     10.95    0.2%
   66      5023     19.66    0.3%
   68      5159     10.88    0.2%
   70      5340     12.91    0.2%
   72      5504     15.99    0.2%
   74      5619     10.59    0.1%
   76      5763     24.08    0.4%
   78      5952     12.54    0.2%
   80      6060     10.24    0.1%
   82      6269     20.16    0.3%
   84      6398     9.228    0.1%
   86      6550     12.72    0.1%
   88      6686     12.73    0.1%
   90      6825     16.99    0.2%
   92      7019     20.11    0.2%
   94      7155      10.4    0.1%
   96      7314     21.03    0.2%
   98      7431      16.2    0.2%
  100      7617     17.06    0.2%

Quality and confidence:
param     error
p         0.031

Model:
Time ~=    51.28
    + p    75.41
              µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)

…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs
@joao-paulo-parity
Copy link
Contributor

joao-paulo-parity commented Jul 13, 2021

/benchmark runtime pallet pallet_treasury

paritytech/bench-bot@fdb04e7

@parity-benchapp
Copy link

parity-benchapp bot commented Jul 13, 2021

Benchmark Runtime Pallet for branch "shawntabrizi-test-benchmark-bot" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results
Pallet: "pallet_treasury", Extrinsic: "propose_spend", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    52.83
              µs

Reads = 1
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    52.83
              µs

Reads = 1
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "reject_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    48.82
              µs

Reads = 2
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    48.82
              µs

Reads = 2
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "approve_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    16.65
    + p    0.155
              µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    p   mean µs  sigma µs       %
    0     14.23     0.044    0.3%
    1      15.3     0.041    0.2%
    2     15.21     0.039    0.2%
    3     16.23     0.041    0.2%
    4     16.11     0.051    0.3%
    5     16.62     0.037    0.2%
    6     17.53     0.049    0.2%
    7     17.27     0.095    0.5%
    8     17.48      0.05    0.2%
    9     18.12     0.114    0.6%
   10      17.8     0.082    0.4%
   11     18.41     0.055    0.2%
   12     18.07     0.102    0.5%
   13     18.86     0.088    0.4%
   14     18.44     0.117    0.6%
   15     18.52     0.066    0.3%
   16     19.18     0.068    0.3%
   17     18.94     0.054    0.2%
   18      19.6     0.043    0.2%
   19     19.81     0.075    0.3%
   20      19.8     0.118    0.5%
   21     20.24     0.163    0.8%
   22      20.1     0.132    0.6%
   23     20.83     0.061    0.2%
   24     20.19     0.094    0.4%
   25     20.63     0.056    0.2%
   26      20.8     0.141    0.6%
   27     20.83      0.08    0.3%
   28     21.23     0.079    0.3%
   29     21.21     0.089    0.4%
   30     21.46     0.129    0.6%
   31     21.79     0.089    0.4%
   32     21.84     0.102    0.4%
   33     21.84     0.106    0.4%
   34     22.23      0.14    0.6%
   35      22.3     0.122    0.5%
   36     21.91     0.139    0.6%
   37     22.71     0.116    0.5%
   38     21.43       0.9    4.1%
   39     21.68     0.835    3.8%
   40     22.95     0.236    1.0%
   41      23.3     0.138    0.5%
   42     23.17     0.613    2.6%
   43     20.82     1.294    6.2%
   44     22.92     1.035    4.5%
   45     23.23     0.869    3.7%
   46     24.07     0.218    0.9%
   47     23.75     0.988    4.1%
   48      21.1      2.03    9.6%
   49     20.48     1.939    9.4%
   50     24.97     0.904    3.6%
   51     25.41      0.13    0.5%
   52     24.86     0.149    0.5%
   53     24.93      0.12    0.4%
   54     25.03     0.142    0.5%
   55     25.68     0.061    0.2%
   56     25.45     0.169    0.6%
   57      25.7     0.081    0.3%
   58     25.86     0.124    0.4%
   59     26.71     0.181    0.6%
   60     25.92      0.13    0.5%
   61     26.27     0.097    0.3%
   62     26.49     0.128    0.4%
   63     26.92     0.113    0.4%
   64      26.8     0.091    0.3%
   65     26.77     0.073    0.2%
   66     27.56     0.121    0.4%
   67     27.15     0.112    0.4%
   68     27.64     0.131    0.4%
   69     27.43     0.119    0.4%
   70     27.68      0.13    0.4%
   71     28.09     0.128    0.4%
   72     28.31     0.108    0.3%
   73      28.1     0.188    0.6%
   74     28.72     0.137    0.4%
   75     28.37     0.078    0.2%
   76     28.57     0.114    0.3%
   77     28.49     0.156    0.5%
   78     28.59     0.089    0.3%
   79     28.94       0.2    0.6%
   80     29.32      0.14    0.4%
   81     29.47     0.145    0.4%
   82     29.81     0.172    0.5%
   83     28.22     1.967    6.9%
   84     28.44     1.849    6.5%
   85     29.77     0.252    0.8%
   86     29.26     2.075    7.0%
   87     29.96     0.151    0.5%
   88     30.43      0.13    0.4%
   89     30.25     0.167    0.5%
   90     29.98     0.226    0.7%
   91     26.15     4.472   17.0%
   92     23.46     4.417   18.8%
   93     24.74     4.243   17.1%
   94      20.4     0.108    0.5%
   95     20.48     0.141    0.6%
   96     21.19     0.153    0.7%
   97     20.91     0.125    0.5%
   98     23.89     3.331   13.9%
   99     24.44     2.121    8.6%

Quality and confidence:
param     error
p         0.002

Model:
Time ~=    17.54
    + p    0.118
              µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Pallet: "pallet_treasury", Extrinsic: "on_initialize_proposals", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    71.88
    + p     76.6
              µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    p   mean µs  sigma µs       %
    0     78.77     0.213    0.2%
    2     232.9     0.261    0.1%
    4     381.8     0.629    0.1%
    6       531     0.959    0.1%
    8     683.6     1.023    0.1%
   10     834.1     1.121    0.1%
   12       993     11.08    1.1%
   14      1138     1.655    0.1%
   16      1288     3.366    0.2%
   18      1438     7.631    0.5%
   20      1606     14.49    0.9%
   22      1753     11.08    0.6%
   24      1904     9.562    0.5%
   26      2062     19.32    0.9%
   28      2205     13.59    0.6%
   30      2397     14.14    0.5%
   32      2530     11.77    0.4%
   34      2657     13.12    0.4%
   36      2815     10.27    0.3%
   38      2979      10.2    0.3%
   40      3134      15.5    0.4%
   42      3287     12.74    0.3%
   44      3436     12.39    0.3%
   46      3586     16.31    0.4%
   48      3742     10.27    0.2%
   50      3907     7.234    0.1%
   52      4026     13.61    0.3%
   54      4197     15.99    0.3%
   56      4369     10.29    0.2%
   58      4498     8.616    0.1%
   60      4749     13.26    0.2%
   62      4898     13.63    0.2%
   64      4945     18.36    0.3%
   66      5118     16.56    0.3%
   68      5261     10.28    0.1%
   70      5432     13.12    0.2%
   72      5602     13.61    0.2%
   74      5734     12.65    0.2%
   76      5919     14.32    0.2%
   78      6026     16.06    0.2%
   80      6206      13.9    0.2%
   82      6367     16.27    0.2%
   84      6549     25.12    0.3%
   86      6646     11.34    0.1%
   88      6845     16.37    0.2%
   90      6987     15.77    0.2%
   92      7100     18.38    0.2%
   94      7302      22.1    0.3%
   96      7390     13.33    0.1%
   98      7579     8.694    0.1%
  100      7713     15.48    0.2%

Quality and confidence:
param     error
p         0.038

Model:
Time ~=    69.66
    + p    76.67
              µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)

…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs
@joao-paulo-parity
Copy link
Contributor

joao-paulo-parity commented Jul 13, 2021

/benchmark runtime pallet pallet_treasury

paritytech/bench-bot@a860dd5

@parity-benchapp
Copy link

parity-benchapp bot commented Jul 13, 2021

Benchmark Runtime Pallet for branch "shawntabrizi-test-benchmark-bot" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results
Pallet: "pallet_treasury", Extrinsic: "propose_spend", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    52.83
              µs

Reads = 1
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    52.83
              µs

Reads = 1
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "reject_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    48.82
              µs

Reads = 2
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    48.82
              µs

Reads = 2
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "approve_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    16.65
    + p    0.155
              µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    p   mean µs  sigma µs       %
    0     14.23     0.044    0.3%
    1      15.3     0.041    0.2%
    2     15.21     0.039    0.2%
    3     16.23     0.041    0.2%
    4     16.11     0.051    0.3%
    5     16.62     0.037    0.2%
    6     17.53     0.049    0.2%
    7     17.27     0.095    0.5%
    8     17.48      0.05    0.2%
    9     18.12     0.114    0.6%
   10      17.8     0.082    0.4%
   11     18.41     0.055    0.2%
   12     18.07     0.102    0.5%
   13     18.86     0.088    0.4%
   14     18.44     0.117    0.6%
   15     18.52     0.066    0.3%
   16     19.18     0.068    0.3%
   17     18.94     0.054    0.2%
   18      19.6     0.043    0.2%
   19     19.81     0.075    0.3%
   20      19.8     0.118    0.5%
   21     20.24     0.163    0.8%
   22      20.1     0.132    0.6%
   23     20.83     0.061    0.2%
   24     20.19     0.094    0.4%
   25     20.63     0.056    0.2%
   26      20.8     0.141    0.6%
   27     20.83      0.08    0.3%
   28     21.23     0.079    0.3%
   29     21.21     0.089    0.4%
   30     21.46     0.129    0.6%
   31     21.79     0.089    0.4%
   32     21.84     0.102    0.4%
   33     21.84     0.106    0.4%
   34     22.23      0.14    0.6%
   35      22.3     0.122    0.5%
   36     21.91     0.139    0.6%
   37     22.71     0.116    0.5%
   38     21.43       0.9    4.1%
   39     21.68     0.835    3.8%
   40     22.95     0.236    1.0%
   41      23.3     0.138    0.5%
   42     23.17     0.613    2.6%
   43     20.82     1.294    6.2%
   44     22.92     1.035    4.5%
   45     23.23     0.869    3.7%
   46     24.07     0.218    0.9%
   47     23.75     0.988    4.1%
   48      21.1      2.03    9.6%
   49     20.48     1.939    9.4%
   50     24.97     0.904    3.6%
   51     25.41      0.13    0.5%
   52     24.86     0.149    0.5%
   53     24.93      0.12    0.4%
   54     25.03     0.142    0.5%
   55     25.68     0.061    0.2%
   56     25.45     0.169    0.6%
   57      25.7     0.081    0.3%
   58     25.86     0.124    0.4%
   59     26.71     0.181    0.6%
   60     25.92      0.13    0.5%
   61     26.27     0.097    0.3%
   62     26.49     0.128    0.4%
   63     26.92     0.113    0.4%
   64      26.8     0.091    0.3%
   65     26.77     0.073    0.2%
   66     27.56     0.121    0.4%
   67     27.15     0.112    0.4%
   68     27.64     0.131    0.4%
   69     27.43     0.119    0.4%
   70     27.68      0.13    0.4%
   71     28.09     0.128    0.4%
   72     28.31     0.108    0.3%
   73      28.1     0.188    0.6%
   74     28.72     0.137    0.4%
   75     28.37     0.078    0.2%
   76     28.57     0.114    0.3%
   77     28.49     0.156    0.5%
   78     28.59     0.089    0.3%
   79     28.94       0.2    0.6%
   80     29.32      0.14    0.4%
   81     29.47     0.145    0.4%
   82     29.81     0.172    0.5%
   83     28.22     1.967    6.9%
   84     28.44     1.849    6.5%
   85     29.77     0.252    0.8%
   86     29.26     2.075    7.0%
   87     29.96     0.151    0.5%
   88     30.43      0.13    0.4%
   89     30.25     0.167    0.5%
   90     29.98     0.226    0.7%
   91     26.15     4.472   17.0%
   92     23.46     4.417   18.8%
   93     24.74     4.243   17.1%
   94      20.4     0.108    0.5%
   95     20.48     0.141    0.6%
   96     21.19     0.153    0.7%
   97     20.91     0.125    0.5%
   98     23.89     3.331   13.9%
   99     24.44     2.121    8.6%

Quality and confidence:
param     error
p         0.002

Model:
Time ~=    17.54
    + p    0.118
              µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Pallet: "pallet_treasury", Extrinsic: "on_initialize_proposals", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    71.88
    + p     76.6
              µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    p   mean µs  sigma µs       %
    0     78.77     0.213    0.2%
    2     232.9     0.261    0.1%
    4     381.8     0.629    0.1%
    6       531     0.959    0.1%
    8     683.6     1.023    0.1%
   10     834.1     1.121    0.1%
   12       993     11.08    1.1%
   14      1138     1.655    0.1%
   16      1288     3.366    0.2%
   18      1438     7.631    0.5%
   20      1606     14.49    0.9%
   22      1753     11.08    0.6%
   24      1904     9.562    0.5%
   26      2062     19.32    0.9%
   28      2205     13.59    0.6%
   30      2397     14.14    0.5%
   32      2530     11.77    0.4%
   34      2657     13.12    0.4%
   36      2815     10.27    0.3%
   38      2979      10.2    0.3%
   40      3134      15.5    0.4%
   42      3287     12.74    0.3%
   44      3436     12.39    0.3%
   46      3586     16.31    0.4%
   48      3742     10.27    0.2%
   50      3907     7.234    0.1%
   52      4026     13.61    0.3%
   54      4197     15.99    0.3%
   56      4369     10.29    0.2%
   58      4498     8.616    0.1%
   60      4749     13.26    0.2%
   62      4898     13.63    0.2%
   64      4945     18.36    0.3%
   66      5118     16.56    0.3%
   68      5261     10.28    0.1%
   70      5432     13.12    0.2%
   72      5602     13.61    0.2%
   74      5734     12.65    0.2%
   76      5919     14.32    0.2%
   78      6026     16.06    0.2%
   80      6206      13.9    0.2%
   82      6367     16.27    0.2%
   84      6549     25.12    0.3%
   86      6646     11.34    0.1%
   88      6845     16.37    0.2%
   90      6987     15.77    0.2%
   92      7100     18.38    0.2%
   94      7302      22.1    0.3%
   96      7390     13.33    0.1%
   98      7579     8.694    0.1%
  100      7713     15.48    0.2%

Quality and confidence:
param     error
p         0.038

Model:
Time ~=    69.66
    + p    76.67
              µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)

…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs
@joao-paulo-parity
Copy link
Contributor

joao-paulo-parity commented Jul 13, 2021

/benchmark runtime pallet pallet_treasury

paritytech/bench-bot@52d5518

@parity-benchapp
Copy link

parity-benchapp bot commented Jul 13, 2021

Benchmark Runtime Pallet for branch "shawntabrizi-test-benchmark-bot" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results
Pallet: "pallet_treasury", Extrinsic: "propose_spend", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    52.42
              µs

Reads = 1
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    52.42
              µs

Reads = 1
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "reject_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    49.17
              µs

Reads = 2
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    49.17
              µs

Reads = 2
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "approve_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    16.49
    + p    0.156
              µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    p   mean µs  sigma µs       %
    0      14.1     0.027    0.1%
    1     15.05     0.037    0.2%
    2     15.29     0.035    0.2%
    3     16.17     0.089    0.5%
    4     16.11      0.09    0.5%
    5     16.34      0.07    0.4%
    6     17.28     0.042    0.2%
    7     16.83     0.078    0.4%
    8     17.43     0.052    0.2%
    9     18.15     0.065    0.3%
   10     17.72     0.055    0.3%
   11     18.34     0.044    0.2%
   12      17.7      0.12    0.6%
   13     18.66     0.079    0.4%
   14     18.26     0.074    0.4%
   15     18.31     0.159    0.8%
   16     19.24     0.084    0.4%
   17     18.65     0.044    0.2%
   18     19.37     0.072    0.3%
   19     19.32     0.127    0.6%
   20     19.45     0.116    0.5%
   21     20.27     0.135    0.6%
   22     20.23     0.093    0.4%
   23     20.39     0.132    0.6%
   24     20.15      0.11    0.5%
   25     20.58      0.14    0.6%
   26     20.91     0.149    0.7%
   27      20.9     0.115    0.5%
   28     20.98     0.098    0.4%
   29     21.33     0.079    0.3%
   30     21.47     0.141    0.6%
   31      21.7     0.097    0.4%
   32     22.06     0.125    0.5%
   33     21.98     0.142    0.6%
   34     21.92     0.138    0.6%
   35     22.23     0.115    0.5%
   36     22.13     0.091    0.4%
   37     22.88     0.177    0.7%
   38     22.31     0.094    0.4%
   39     23.03      0.17    0.7%
   40     22.93     0.132    0.5%
   41        23     0.047    0.2%
   42     23.24     0.075    0.3%
   43     23.68     0.088    0.3%
   44     23.64     0.091    0.3%
   45      23.6      0.16    0.6%
   46     23.87     0.073    0.3%
   47     23.72     0.126    0.5%
   48     24.56     0.095    0.3%
   49     24.67     0.121    0.4%
   50     25.42     0.199    0.7%
   51     25.32     0.152    0.6%
   52     24.74     0.101    0.4%
   53     25.15     0.092    0.3%
   54     25.43      0.29    1.1%
   55      25.3     0.131    0.5%
   56     25.43     0.103    0.4%
   57     25.59     0.112    0.4%
   58     25.59     0.094    0.3%
   59     26.22     0.083    0.3%
   60      25.8       0.2    0.7%
   61     26.09     0.211    0.8%
   62     26.27     0.183    0.6%
   63     26.44     0.216    0.8%
   64     26.47     0.146    0.5%
   65     26.47     0.093    0.3%
   66     27.12     0.148    0.5%
   67     26.99     0.079    0.2%
   68      27.2     0.099    0.3%
   69     27.14     0.123    0.4%
   70     27.44     0.154    0.5%
   71     27.99     0.123    0.4%
   72     28.12     0.122    0.4%
   73     27.39     0.209    0.7%
   74      28.3     0.178    0.6%
   75     28.07     0.136    0.4%
   76     28.19       0.1    0.3%
   77      28.3     0.161    0.5%
   78     28.38     0.078    0.2%
   79     28.28     0.122    0.4%
   80     29.24     0.171    0.5%
   81     29.31     0.141    0.4%
   82     29.61      0.19    0.6%
   83     29.28     0.234    0.7%
   84     29.85     0.113    0.3%
   85     29.78     0.136    0.4%
   86     30.71     0.073    0.2%
   87     29.75     0.107    0.3%
   88     30.37     0.106    0.3%
   89     29.85     0.171    0.5%
   90     30.24     0.118    0.3%
   91     29.94     0.192    0.6%
   92     30.15     0.091    0.3%
   93     30.54     0.163    0.5%
   94     30.51      0.07    0.2%
   95     30.63     0.155    0.5%
   96     31.35     0.152    0.4%
   97     30.94     0.149    0.4%
   98     31.49     0.147    0.4%
   99      31.4      0.12    0.3%

Quality and confidence:
param     error
p             0

Model:
Time ~=    16.34
    + p    0.158
              µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Pallet: "pallet_treasury", Extrinsic: "on_initialize_proposals", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    68.22
    + p    76.27
              µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    p   mean µs  sigma µs       %
    0     78.58      0.21    0.2%
    2     231.2     0.294    0.1%
    4     376.8     1.071    0.2%
    6     526.3     0.429    0.0%
    8       679     1.215    0.1%
   10       832     2.385    0.2%
   12     977.9     1.738    0.1%
   14      1133     6.575    0.5%
   16      1280      1.79    0.1%
   18      1433     7.306    0.5%
   20      1578     1.829    0.1%
   22      1738     14.32    0.8%
   24      1900     12.19    0.6%
   26      2039     14.21    0.6%
   28      2201     15.09    0.6%
   30      2341     13.38    0.5%
   32      2499     13.56    0.5%
   34      2660     14.57    0.5%
   36      2796     16.74    0.5%
   38      2989     14.46    0.4%
   40      3114     13.29    0.4%
   42      3241     11.34    0.3%
   44      3424     18.36    0.5%
   46      3577     9.868    0.2%
   48      3702     14.51    0.3%
   50      3871     11.55    0.2%
   52      4035     12.22    0.3%
   54      4164     10.03    0.2%
   56      4326     18.91    0.4%
   58      4480     12.22    0.2%
   60      4691     13.73    0.2%
   62      4794     12.62    0.2%
   64      4920     12.08    0.2%
   66      5093     9.899    0.1%
   68      5270     17.92    0.3%
   70      5406     8.624    0.1%
   72      5509     10.07    0.1%
   74      5733     11.39    0.1%
   76      5865     6.087    0.1%
   78      6020      18.9    0.3%
   80      6179     14.93    0.2%
   82      6337     14.08    0.2%
   84      6484     14.79    0.2%
   86      6639     17.48    0.2%
   88      6849     21.81    0.3%
   90      6899     12.75    0.1%
   92      7102     15.44    0.2%
   94      7211     15.42    0.2%
   96      7386      11.6    0.1%
   98      7559     11.81    0.1%
  100      7717     20.05    0.2%

Quality and confidence:
param     error
p         0.034

Model:
Time ~=    61.54
    + p    76.38
              µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)

@paritytech paritytech deleted a comment from parity-benchapp bot Jul 13, 2021
@paritytech paritytech deleted a comment from parity-benchapp bot Jul 13, 2021
@paritytech paritytech deleted a comment from parity-benchapp bot Jul 13, 2021
@parity-benchapp
Copy link

parity-benchapp bot commented Jul 13, 2021

Benchmark Runtime Pallet for branch "shawntabrizi-test-benchmark-bot" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results
Pallet: "pallet_treasury", Extrinsic: "propose_spend", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    50.24
              µs

Reads = 1
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    50.24
              µs

Reads = 1
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "reject_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    48.23
              µs

Reads = 2
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    48.23
              µs

Reads = 2
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "approve_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    16.08
    + p    0.156
              µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    p   mean µs  sigma µs       %
    0      13.8     0.033    0.2%
    1      14.6     0.035    0.2%
    2     15.03     0.044    0.2%
    3     15.76     0.043    0.2%
    4     15.62     0.069    0.4%
    5     16.02     0.048    0.2%
    6     16.96     0.079    0.4%
    7      16.6     0.041    0.2%
    8     17.06     0.039    0.2%
    9     17.55     0.064    0.3%
   10     17.18     0.043    0.2%
   11     17.81     0.031    0.1%
   12     17.67     0.057    0.3%
   13     18.29     0.085    0.4%
   14      17.9     0.085    0.4%
   15     18.11     0.058    0.3%
   16     18.87     0.093    0.4%
   17     18.51     0.062    0.3%
   18     19.06     0.088    0.4%
   19     19.37     0.086    0.4%
   20     19.46     0.156    0.8%
   21     19.62     0.077    0.3%
   22     20.01     0.072    0.3%
   23     20.23     0.063    0.3%
   24     19.52      0.07    0.3%
   25     20.17       0.1    0.4%
   26     20.56     0.141    0.6%
   27     20.64     0.127    0.6%
   28     20.93     0.081    0.3%
   29     20.86     0.063    0.3%
   30     21.29     0.094    0.4%
   31     21.46     0.124    0.5%
   32     21.73     0.123    0.5%
   33     21.27     0.455    2.1%
   34     21.45     0.774    3.6%
   35      20.3     1.609    7.9%
   36     19.78     1.587    8.0%
   37      18.7     0.287    1.5%
   38      20.8     0.918    4.4%
   39     21.17      0.62    2.9%
   40     22.75      0.11    0.4%
   41     22.65     0.205    0.9%
   42     23.07     0.173    0.7%
   43     23.55      0.15    0.6%
   44     23.28     0.197    0.8%
   45     23.25     0.195    0.8%
   46     23.75     0.143    0.6%
   47     23.58     0.141    0.5%
   48     24.34     0.107    0.4%
   49     24.01     0.136    0.5%
   50      24.9      0.12    0.4%
   51     25.14     0.201    0.7%
   52     24.28     0.138    0.5%
   53     24.52     0.144    0.5%
   54     24.87     0.389    1.5%
   55     25.51     0.123    0.4%
   56     19.05      0.08    0.4%
   57     19.39     0.162    0.8%
   58     19.21      0.12    0.6%
   59      19.5     0.135    0.6%
   60     19.13     0.132    0.6%
   61     19.28     0.052    0.2%
   62     19.54     0.192    0.9%
   63     23.81     3.041   12.7%
   64     22.29     3.108   13.9%
   65     26.27     0.064    0.2%
   66     26.83     0.161    0.5%
   67     27.06     0.163    0.6%
   68     26.84     0.231    0.8%
   69     26.82     0.145    0.5%
   70     26.96     0.117    0.4%
   71     27.69     0.213    0.7%
   72     27.71     0.129    0.4%
   73     27.27     0.133    0.4%
   74     28.34     0.145    0.5%
   75     27.66     0.094    0.3%
   76     27.78     0.156    0.5%
   77     27.91     0.095    0.3%
   78     28.24     0.124    0.4%
   79     28.37     0.132    0.4%
   80     28.76     0.145    0.5%
   81     29.14     0.129    0.4%
   82     29.22     0.163    0.5%
   83      28.9     0.236    0.8%
   84     29.44      0.18    0.6%
   85      29.3     0.078    0.2%
   86     30.47     0.294    0.9%
   87     29.47     0.169    0.5%
   88     30.44     0.111    0.3%
   89     29.93     0.117    0.3%
   90     30.01      0.11    0.3%
   91     30.31     0.127    0.4%
   92     20.35     0.307    1.5%
   93     25.53     3.346   13.1%
   94      20.2     0.151    0.7%
   95     20.24     0.259    1.2%
   96     31.09     0.125    0.4%
   97     30.78     0.093    0.3%
   98     31.59     0.152    0.4%
   99     30.98     0.118    0.3%

Quality and confidence:
param     error
p         0.002

Model:
Time ~=    16.15
    + p    0.137
              µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Pallet: "pallet_treasury", Extrinsic: "on_initialize_proposals", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    81.84
    + p    74.88
              µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    p   mean µs  sigma µs       %
    0     93.22     8.334    8.9%
    2       238     14.03    5.8%
    4     383.3     0.374    0.0%
    6     530.9     0.463    0.0%
    8     683.4      0.72    0.1%
   10     830.7     2.837    0.3%
   12     992.4     2.976    0.2%
   14      1153     4.126    0.3%
   16      1306     5.927    0.4%
   18      1446     1.883    0.1%
   20      1598     2.538    0.1%
   22      1786      6.13    0.3%
   24      1882     5.806    0.3%
   26      2008     11.35    0.5%
   28      2152      13.4    0.6%
   30      2300     9.692    0.4%
   32      2459     11.41    0.4%
   34      2597     13.75    0.5%
   36      2761     15.69    0.5%
   38      2927     18.12    0.6%
   40      3062     9.675    0.3%
   42      3191     12.64    0.3%
   44      3365     5.231    0.1%
   46      3510     9.689    0.2%
   48      3651     9.944    0.2%
   50      3816     7.723    0.2%
   52      3967     8.751    0.2%
   54      4081     7.645    0.1%
   56      4261     17.52    0.4%
   58      4388     15.42    0.3%
   60      4555     5.353    0.1%
   62      4698     7.765    0.1%
   64      4849     9.641    0.1%
   66      5013     12.58    0.2%
   68      5196     27.73    0.5%
   70      5326     13.61    0.2%
   72      5467     9.591    0.1%
   74      5643     13.76    0.2%
   76      5768     18.83    0.3%
   78      5944     12.51    0.2%
   80      6076     10.39    0.1%
   82      6202     11.11    0.1%
   84      6368     8.299    0.1%
   86      6525     11.51    0.1%
   88      6692     20.81    0.3%
   90      6841     11.99    0.1%
   92      6984     16.29    0.2%
   94      7113     7.704    0.1%
   96      7278     7.027    0.0%
   98      7430     14.73    0.1%
  100      7612     13.75    0.1%

Quality and confidence:
param     error
p         0.035

Model:
Time ~=    78.35
    + p    74.91
              µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)

…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs
@parity-benchapp
Copy link

parity-benchapp bot commented Jul 13, 2021

Finished benchmark for branch: shawntabrizi-test-benchmark-bot

Benchmark: Benchmark Runtime Pallet

cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results

Pallet: "pallet_treasury", Extrinsic: "propose_spend", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 51.84
µs

Reads = 1
Writes = 2
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 51.84
µs

Reads = 1
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "reject_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 47.56
µs

Reads = 2
Writes = 2
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 47.56
µs

Reads = 2
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "approve_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 16.63
+ p 0.146
µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
p mean µs sigma µs %
0 13.75 0.098 0.7%
1 14.45 0.046 0.3%
2 14.8 0.04 0.2%
3 15.47 0.053 0.3%
4 15.74 0.056 0.3%
5 15.86 0.039 0.2%
6 16.95 0.051 0.3%
7 16.78 0.067 0.3%
8 16.89 0.052 0.3%
9 17.67 0.057 0.3%
10 17.46 0.08 0.4%
11 18.09 0.101 0.5%
12 17.9 0.069 0.3%
13 18.35 0.059 0.3%
14 18.2 0.056 0.3%
15 18.22 0.054 0.2%
16 19.17 0.058 0.3%
17 18.87 0.067 0.3%
18 19.45 0.079 0.4%
19 19.63 0.083 0.4%
20 19.13 0.059 0.3%
21 20.07 0.069 0.3%
22 19.92 0.071 0.3%
23 20.19 0.09 0.4%
24 19.88 0.131 0.6%
25 18.21 0.763 4.1%
26 17.95 0.116 0.6%
27 17.94 0.109 0.6%
28 18.13 0.093 0.5%
29 18.14 0.048 0.2%
30 19.43 1.396 7.1%
31 20.77 1.064 5.1%
32 21.71 0.094 0.4%
33 21.58 0.093 0.4%
34 21.96 0.083 0.3%
35 22.22 0.086 0.3%
36 21.87 0.073 0.3%
37 22.28 0.167 0.7%
38 22.23 0.145 0.6%
39 22.57 0.065 0.2%
40 22.85 0.124 0.5%
41 23.08 0.074 0.3%
42 23.01 0.095 0.4%
43 23.7 0.129 0.5%
44 23.38 0.099 0.4%
45 23.57 0.135 0.5%
46 23.95 0.098 0.4%
47 23.89 0.114 0.4%
48 24.35 0.077 0.3%
49 24.5 0.161 0.6%
50 25.15 0.098 0.3%
51 25.25 0.095 0.3%
52 24.37 0.116 0.4%
53 24.7 0.118 0.4%
54 24.69 0.208 0.8%
55 24.94 0.708 2.8%
56 25.15 0.086 0.3%
57 25.43 0.104 0.4%
58 25.54 0.122 0.4%
59 25.95 0.098 0.3%
60 25.67 0.107 0.4%
61 25.9 0.077 0.2%
62 24.52 2.599 10.5%
63 26.16 0.148 0.5%
64 24.84 2.652 10.6%
65 26.62 0.065 0.2%
66 26.93 0.141 0.5%
67 26.97 0.091 0.3%
68 26.76 0.104 0.3%
69 27.09 0.101 0.3%
70 25.45 2.716 10.6%
71 20.28 0.087 0.4%
72 20.22 0.084 0.4%
73 19.83 0.069 0.3%
74 19.96 0.074 0.3%
75 19.85 0.194 0.9%
76 25.68 2.072 8.0%
77 27.87 0.162 0.5%
78 28.02 0.079 0.2%
79 28.1 0.093 0.3%
80 28.84 0.089 0.3%
81 29.2 0.066 0.2%
82 29.02 0.078 0.2%
83 29.18 0.157 0.5%
84 27.07 2.136 7.8%
85 27.65 2.175 7.8%
86 30.04 0.098 0.3%
87 29.2 0.08 0.2%
88 29.45 1.474 5.0%
89 28.01 2.087 7.4%
90 29.58 0.124 0.4%
91 26.32 4.07 15.4%
92 22.34 3.801 17.0%
93 25.28 4.697 18.5%
94 20.1 0.09 0.4%
95 20.57 0.121 0.5%
96 20.62 0.07 0.3%
97 20.13 0.063 0.3%
98 20.66 0.118 0.5%
99 21.29 1.305 6.1%

Quality and confidence:
param error
p 0.003

Model:
Time ~= 17.35
+ p 0.104
µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Pallet: "pallet_treasury", Extrinsic: "on_initialize_proposals", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 69.34
+ p 75.06
µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
p mean µs sigma µs %
0 75.6 0.131 0.1%
2 227.3 0.342 0.1%
4 370.2 0.547 0.1%
6 520.5 5.944 1.1%
8 667.3 0.767 0.1%
10 825.5 14.09 1.7%
12 967.3 12.91 1.3%
14 1109 8.25 0.7%
16 1259 11.91 0.9%
18 1401 1.621 0.1%
20 1555 11.45 0.7%
22 1722 14.63 0.8%
24 1880 17.59 0.9%
26 2034 2.195 0.1%
28 2196 1.686 0.0%
30 2343 1.453 0.0%
32 2504 2.573 0.1%
34 2592 7.842 0.3%
36 2775 14.22 0.5%
38 2896 8.929 0.3%
40 3063 13.4 0.4%
42 3220 17.2 0.5%
44 3349 17.15 0.5%
46 3495 15.34 0.4%
48 3651 18.15 0.4%
50 3833 9.491 0.2%
52 3965 7.121 0.1%
54 4100 15.24 0.3%
56 4253 12.31 0.2%
58 4401 9.941 0.2%
60 4542 12.95 0.2%
62 4714 14.26 0.3%
64 4813 9.486 0.1%
66 5007 10.78 0.2%
68 5179 18.89 0.3%
70 5311 12.24 0.2%
72 5446 10.98 0.2%
74 5635 11.18 0.1%
76 5801 23.34 0.4%
78 5937 16.63 0.2%
80 6090 15.99 0.2%
82 6218 12.46 0.2%
84 6386 18.71 0.2%
86 6521 15.05 0.2%
88 6704 20.39 0.3%
90 6836 11.69 0.1%
92 6961 10.68 0.1%
94 7154 14.18 0.1%
96 7292 15.27 0.2%
98 7436 8.288 0.1%
100 7569 7.745 0.1%

Quality and confidence:
param error
p 0.033

Model:
Time ~= 64.11
+ p 75.11
µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)

Parity Bot added 2 commits July 13, 2021 08:04
…/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs
@joao-paulo-parity
Copy link
Contributor

joao-paulo-parity commented Jul 13, 2021

/benchmark runtime pallet pallet_treasury

paritytech/bench-bot@ee7bf89

@parity-benchapp
Copy link

parity-benchapp bot commented Jul 13, 2021

Finished benchmark for branch: shawntabrizi-test-benchmark-bot

Benchmark: Benchmark Runtime Pallet

cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results

Pallet: "pallet_treasury", Extrinsic: "propose_spend", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 51.03
µs

Reads = 1
Writes = 2
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 51.03
µs

Reads = 1
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "reject_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 47.14
µs

Reads = 2
Writes = 2
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 47.14
µs

Reads = 2
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "approve_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 16.05
+ p 0.159
µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
p mean µs sigma µs %
0 13.54 0.088 0.6%
1 14.9 0.046 0.3%
2 14.79 0.06 0.4%
3 15.55 0.065 0.4%
4 15.48 0.094 0.6%
5 15.94 0.047 0.2%
6 16.96 0.049 0.2%
7 16.39 0.082 0.5%
8 16.7 0.055 0.3%
9 17.4 0.076 0.4%
10 17.06 0.077 0.4%
11 17.84 0.1 0.5%
12 17.45 0.059 0.3%
13 18.09 0.077 0.4%
14 18.03 0.057 0.3%
15 18.09 0.078 0.4%
16 18.59 0.078 0.4%
17 18.44 0.064 0.3%
18 19.15 0.05 0.2%
19 19.34 0.057 0.2%
20 19.19 0.064 0.3%
21 19.99 0.065 0.3%
22 20.2 0.05 0.2%
23 20.41 0.066 0.3%
24 19.4 0.086 0.4%
25 20.27 0.108 0.5%
26 20.65 0.093 0.4%
27 20.99 0.036 0.1%
28 20.87 0.063 0.3%
29 20.9 0.07 0.3%
30 21.38 0.215 1.0%
31 21.44 0.059 0.2%
32 21.87 0.132 0.6%
33 20.57 0.578 2.8%
34 20.77 0.906 4.3%
35 21.01 1.225 5.8%
36 20.6 0.728 3.5%
37 21.58 0.645 2.9%
38 19.68 1.138 5.7%
39 19.63 0.765 3.8%
40 21.85 1.015 4.6%
41 23.19 0.196 0.8%
42 22.87 0.093 0.4%
43 23.6 0.155 0.6%
44 23.29 0.19 0.8%
45 23.3 0.53 2.2%
46 21.33 1.915 8.9%
47 22.56 1.219 5.4%
48 24.15 0.109 0.4%
49 24.24 0.065 0.2%
50 24.98 0.085 0.3%
51 24.89 0.167 0.6%
52 24.36 0.063 0.2%
53 24.64 0.121 0.4%
54 24.99 0.174 0.6%
55 25.28 0.199 0.7%
56 24.85 0.117 0.4%
57 25.28 0.089 0.3%
58 25.39 0.23 0.9%
59 26.04 0.107 0.4%
60 25.54 0.085 0.3%
61 25.78 0.118 0.4%
62 26.05 0.127 0.4%
63 26.54 0.07 0.2%
64 26.29 0.146 0.5%
65 26.22 0.119 0.4%
66 26.85 0.17 0.6%
67 26.89 0.18 0.6%
68 26.82 0.072 0.2%
69 26.82 0.087 0.3%
70 27.33 0.144 0.5%
71 27.67 0.159 0.5%
72 27.81 0.107 0.3%
73 27.84 0.125 0.4%
74 28.16 0.143 0.5%
75 27.74 0.13 0.4%
76 27.04 1.631 6.0%
77 28.03 0.104 0.3%
78 28.21 0.231 0.8%
79 28.33 0.106 0.3%
80 28.95 0.077 0.2%
81 29.25 0.112 0.3%
82 29.11 0.099 0.3%
83 29.01 0.258 0.8%
84 29.67 0.142 0.4%
85 29.27 0.172 0.5%
86 30.58 0.121 0.3%
87 29.6 0.16 0.5%
88 29.99 0.107 0.3%
89 29.89 0.172 0.5%
90 29.71 0.145 0.4%
91 30.04 0.172 0.5%
92 30.05 0.248 0.8%
93 29.71 1.509 5.0%
94 28.31 2.633 9.3%
95 29.91 1.62 5.4%
96 31.3 0.146 0.4%
97 29.49 2.469 8.3%
98 30.2 2.001 6.6%
99 30.08 1.921 6.3%

Quality and confidence:
param error
p 0.001

Model:
Time ~= 15.83
+ p 0.159
µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Pallet: "pallet_treasury", Extrinsic: "on_initialize_proposals", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 59.73
+ p 76.41
µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
p mean µs sigma µs %
0 78.35 0.231 0.2%
2 229.1 0.864 0.3%
4 376.9 0.643 0.1%
6 524.4 0.919 0.1%
8 678.9 0.718 0.1%
10 828.2 2.026 0.2%
12 976.9 1.342 0.1%
14 1142 16.45 1.4%
16 1273 2.331 0.1%
18 1435 7.35 0.5%
20 1580 7.833 0.4%
22 1738 10.85 0.6%
24 1898 12.71 0.6%
26 2029 9.261 0.4%
28 2189 13.34 0.6%
30 2327 7.65 0.3%
32 2493 13.99 0.5%
34 2654 14.91 0.5%
36 2794 10.67 0.3%
38 2943 15 0.5%
40 3116 8.214 0.2%
42 3266 8.523 0.2%
44 3401 9.725 0.2%
46 3558 10.93 0.3%
48 3718 6.544 0.1%
50 3849 5.298 0.1%
52 3974 9.489 0.2%
54 4155 9.347 0.2%
56 4326 5.777 0.1%
58 4472 11.42 0.2%
60 4639 10.49 0.2%
62 4780 8.184 0.1%
64 4969 29.97 0.6%
66 5093 14.53 0.2%
68 5240 15.23 0.2%
70 5428 18.7 0.3%
72 5572 13.6 0.2%
74 5740 17.31 0.3%
76 5857 13.75 0.2%
78 6031 19.25 0.3%
80 6205 12.57 0.2%
82 6341 15.88 0.2%
84 6511 16 0.2%
86 6647 11.97 0.1%
88 6870 46.09 0.6%
90 7063 8.262 0.1%
92 7077 43.12 0.6%
94 7224 14.18 0.1%
96 7398 18.65 0.2%
98 7543 10.61 0.1%
100 7715 17 0.2%

Quality and confidence:
param error
p 0.046

Model:
Time ~= 49.71
+ p 76.64
µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)

Parity Bot added 2 commits July 13, 2021 08:35
…/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs
@parity-benchapp
Copy link

parity-benchapp bot commented Jul 13, 2021

Finished benchmark for branch: shawntabrizi-test-benchmark-bot

Benchmark: Benchmark Runtime Pallet

cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results

Pallet: "pallet_treasury", Extrinsic: "propose_spend", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 51.68
µs

Reads = 1
Writes = 2
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 51.68
µs

Reads = 1
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "reject_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 48.84
µs

Reads = 2
Writes = 2
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 48.84
µs

Reads = 2
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "approve_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 16.58
+ p 0.15
µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
p mean µs sigma µs %
0 14.06 0.041 0.2%
1 14.76 0.044 0.2%
2 15.34 0.057 0.3%
3 15.82 0.046 0.2%
4 15.93 0.046 0.2%
5 16.24 0.053 0.3%
6 17.39 0.075 0.4%
7 16.96 0.043 0.2%
8 17.23 0.052 0.3%
9 17.87 0.047 0.2%
10 17.6 0.072 0.4%
11 18.01 0.046 0.2%
12 18.01 0.07 0.3%
13 18.47 0.074 0.4%
14 18.18 0.068 0.3%
15 18.62 0.095 0.5%
16 19.01 0.076 0.3%
17 18.79 0.062 0.3%
18 19.35 0.067 0.3%
19 19.63 0.086 0.4%
20 19.61 0.104 0.5%
21 20.13 0.071 0.3%
22 20.33 0.073 0.3%
23 20.68 0.114 0.5%
24 19.97 0.086 0.4%
25 20.69 0.131 0.6%
26 20.68 0.104 0.5%
27 21.23 0.056 0.2%
28 21.07 0.101 0.4%
29 20.98 0.073 0.3%
30 21.19 0.172 0.8%
31 21.42 0.132 0.6%
32 21.65 0.176 0.8%
33 21.9 0.121 0.5%
34 21.92 0.181 0.8%
35 22.1 0.133 0.6%
36 21.71 0.099 0.4%
37 21.66 0.807 3.7%
38 21.06 0.807 3.8%
39 22.06 0.713 3.2%
40 23.07 0.113 0.4%
41 23.32 0.181 0.7%
42 23.28 0.075 0.3%
43 23.56 0.158 0.6%
44 23.61 0.108 0.4%
45 23.73 0.065 0.2%
46 23.8 0.091 0.3%
47 23.8 0.098 0.4%
48 24.79 0.549 2.2%
49 24.23 0.14 0.5%
50 23.56 1.258 5.3%
51 23.7 1.08 4.5%
52 21.78 0.186 0.8%
53 19.58 0.107 0.5%
54 20.72 1.521 7.3%
55 19.79 0.158 0.7%
56 22.8 2.777 12.1%
57 25.24 0.115 0.4%
58 25.48 0.105 0.4%
59 26.42 0.197 0.7%
60 25.81 0.095 0.3%
61 25.96 0.143 0.5%
62 26.2 0.075 0.2%
63 26.54 0.105 0.3%
64 26.49 0.101 0.3%
65 26.63 0.106 0.3%
66 27.25 0.131 0.4%
67 27.04 0.17 0.6%
68 26.77 0.126 0.4%
69 27.2 0.131 0.4%
70 27.5 0.093 0.3%
71 27.95 0.105 0.3%
72 27.81 0.161 0.5%
73 27.72 0.253 0.9%
74 26.34 1.845 7.0%
75 25.79 1.887 7.3%
76 27.22 1.535 5.6%
77 23.94 0.098 0.4%
78 28.17 0.193 0.6%
79 28.44 0.067 0.2%
80 28.9 0.113 0.3%
81 29.35 0.143 0.4%
82 29.57 0.153 0.5%
83 29.04 0.136 0.4%
84 29.37 0.132 0.4%
85 29.18 0.127 0.4%
86 22.07 2.621 11.8%
87 22.19 3.55 15.9%
88 30.04 0.213 0.7%
89 29.66 0.088 0.2%
90 29.86 0.263 0.8%
91 29.91 0.105 0.3%
92 29.92 0.152 0.5%
93 30.06 0.158 0.5%
94 29.08 2.091 7.1%
95 30.69 0.227 0.7%
96 26.11 1.585 6.0%
97 25.05 0.141 0.5%
98 24.18 2.061 8.5%
99 20.66 0.122 0.5%

Quality and confidence:
param error
p 0.002

Model:
Time ~= 16.88
+ p 0.129
µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Pallet: "pallet_treasury", Extrinsic: "on_initialize_proposals", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 67.18
+ p 76.5
µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
p mean µs sigma µs %
0 78.74 0.125 0.1%
2 232.2 0.439 0.1%
4 381.6 0.336 0.0%
6 533.3 4.733 0.8%
8 685.7 1.173 0.1%
10 836.3 8.994 1.0%
12 982.7 4.905 0.4%
14 1139 9.947 0.8%
16 1283 8.233 0.6%
18 1438 9.125 0.6%
20 1598 11.95 0.7%
22 1748 11.27 0.6%
24 1885 1.501 0.0%
26 2044 7.133 0.3%
28 2209 9.319 0.4%
30 2344 11.33 0.4%
32 2493 12.15 0.4%
34 2644 12.09 0.4%
36 2824 9.099 0.3%
38 2978 3.177 0.1%
40 3111 12.83 0.4%
42 3252 7.162 0.2%
44 3446 12.93 0.3%
46 3578 6.751 0.1%
48 3729 9.188 0.2%
50 3878 11.77 0.3%
52 4002 10.13 0.2%
54 4183 8.893 0.2%
56 4366 16.57 0.3%
58 4492 13.8 0.3%
60 4652 9.538 0.2%
62 4795 7.092 0.1%
64 4953 10.82 0.2%
66 5108 8.277 0.1%
68 5265 9.727 0.1%
70 5387 9.744 0.1%
72 5585 13.48 0.2%
74 5726 10.61 0.1%
76 5899 18.27 0.3%
78 6031 9.764 0.1%
80 6162 11.17 0.1%
82 6357 9.375 0.1%
84 6489 17.97 0.2%
86 6611 9.301 0.1%
88 6818 11.47 0.1%
90 6944 13.65 0.1%
92 7129 18.58 0.2%
94 7270 7.833 0.1%
96 7435 8.305 0.1%
98 7608 12.57 0.1%
100 7752 16.5 0.2%

Quality and confidence:
param error
p 0.03

Model:
Time ~= 59.45
+ p 76.61
µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)

…/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs
@shawntabrizi
Copy link
Member Author

/benchmark runtime pallet pallet_treasury

@parity-benchapp
Copy link

parity-benchapp bot commented Jul 13, 2021

Finished benchmark for branch: shawntabrizi-test-benchmark-bot

Benchmark: Benchmark Runtime Pallet

cargo run --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results

Pallet: "pallet_treasury", Extrinsic: "propose_spend", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 42.17
µs

Reads = 1
Writes = 2
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 42.17
µs

Reads = 1
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "reject_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 39.49
µs

Reads = 2
Writes = 2
Min Squares Analysis

-- Extrinsic Time --

Model:
Time ~= 39.49
µs

Reads = 2
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "approve_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 13.8
+ p 0.147
µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
p mean µs sigma µs %
0 11.62 0.034 0.2%
1 12.54 0.037 0.2%
2 12.92 0.051 0.3%
3 13.25 0.041 0.3%
4 13.43 0.031 0.2%
5 13.79 0.089 0.6%
6 14.48 0.062 0.4%
7 14.38 0.051 0.3%
8 14.58 0.108 0.7%
9 15.19 0.082 0.5%
10 14.79 0.076 0.5%
11 15.54 0.105 0.6%
12 15.2 0.107 0.7%
13 15.64 0.034 0.2%
14 15.52 0.067 0.4%
15 15.69 0.105 0.6%
16 16.3 0.094 0.5%
17 16.02 0.063 0.3%
18 16.44 0.066 0.4%
19 16.61 0.088 0.5%
20 16.78 0.057 0.3%
21 17.09 0.096 0.5%
22 17.3 0.043 0.2%
23 17.48 0.083 0.4%
24 17.04 0.07 0.4%
25 17.59 0.117 0.6%
26 17.86 0.069 0.3%
27 17.89 0.122 0.6%
28 18.05 0.112 0.6%
29 18.05 0.07 0.3%
30 18.46 0.107 0.5%
31 18.63 0.053 0.2%
32 18.8 0.09 0.4%
33 18.95 0.092 0.4%
34 19.12 0.092 0.4%
35 19.32 0.061 0.3%
36 19.05 0.066 0.3%
37 19.42 0.046 0.2%
38 19.17 0.127 0.6%
39 19.8 0.06 0.3%
40 19.98 0.113 0.5%
41 19.89 0.103 0.5%
42 20.29 0.068 0.3%
43 20.91 0.096 0.4%
44 20.49 0.11 0.5%
45 20.63 0.047 0.2%
46 20.77 0.134 0.6%
47 21.02 0.146 0.6%
48 21.28 0.106 0.4%
49 21.67 0.117 0.5%
50 21.99 0.132 0.6%
51 22.22 0.111 0.4%
52 21.49 0.103 0.4%
53 21.71 0.123 0.5%
54 21.94 0.084 0.3%
55 22.31 0.19 0.8%
56 22.2 0.173 0.7%
57 22.36 0.075 0.3%
58 22.36 0.066 0.2%
59 22.88 0.069 0.3%
60 22.52 0.103 0.4%
61 22.64 0.095 0.4%
62 22.99 0.06 0.2%
63 23.39 0.055 0.2%
64 23.36 0.041 0.1%
65 23.63 0.08 0.3%
66 23.71 0.099 0.4%
67 23.76 0.167 0.7%
68 23.75 0.072 0.3%
69 23.92 0.128 0.5%
70 24.09 0.112 0.4%
71 24.65 0.151 0.6%
72 24.52 0.061 0.2%
73 24.34 0.08 0.3%
74 24.89 0.109 0.4%
75 24.48 0.125 0.5%
76 24.53 0.12 0.4%
77 24.77 0.12 0.4%
78 24.64 0.14 0.5%
79 25.3 0.123 0.4%
80 25.66 0.101 0.3%
81 25.96 0.095 0.3%
82 25.88 0.128 0.4%
83 25.85 0.21 0.8%
84 26.3 0.166 0.6%
85 26.11 0.16 0.6%
86 26.41 0.061 0.2%
87 26.27 0.25 0.9%
88 26.62 0.139 0.5%
89 26.34 0.219 0.8%
90 26.49 0.125 0.4%
91 26.71 0.183 0.6%
92 26.77 0.179 0.6%
93 26.79 0.194 0.7%
94 26.92 0.133 0.4%
95 27.24 0.078 0.2%
96 27.75 0.123 0.4%
97 27.5 0.098 0.3%
98 27.84 0.136 0.4%
99 27.58 0.148 0.5%

Quality and confidence:
param error
p 0

Model:
Time ~= 13.68
+ p 0.148
µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Pallet: "pallet_treasury", Extrinsic: "on_initialize_proposals", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis

-- Extrinsic Time --

Model:
Time ~= 55.03
+ p 60.09
µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)
Min Squares Analysis

-- Extrinsic Time --

Data points distribution:
p mean µs sigma µs %
0 62.07 0.199 0.3%
2 184.4 0.275 0.1%
4 301.9 0.194 0.0%
6 418.7 0.413 0.0%
8 537.6 1.402 0.2%
10 656.9 0.872 0.1%
12 772.6 0.785 0.1%
14 893.9 1.699 0.1%
16 1014 12.74 1.2%
18 1132 2.122 0.1%
20 1247 2.098 0.1%
22 1368 9.054 0.6%
24 1496 10.88 0.7%
26 1599 8.391 0.5%
28 1729 10.14 0.5%
30 1842 10.46 0.5%
32 1958 7.342 0.3%
34 2094 14.01 0.6%
36 2212 8.3 0.3%
38 2334 9.335 0.3%
40 2451 10.82 0.4%
42 2577 8.737 0.3%
44 2704 17.52 0.6%
46 2815 9.52 0.3%
48 2927 8.306 0.2%
50 3061 13.86 0.4%
52 3169 17.49 0.5%
54 3283 7.505 0.2%
56 3419 9.005 0.2%
58 3537 14.28 0.4%
60 3653 19.88 0.5%
62 3775 4.908 0.1%
64 3889 8.548 0.2%
66 4009 7.488 0.1%
68 4126 7.495 0.1%
70 4218 8.259 0.1%
72 4356 12.59 0.2%
74 4507 13.91 0.3%
76 4619 8.957 0.1%
78 4737 12.81 0.2%
80 4865 11.81 0.2%
82 4998 11.49 0.2%
84 5129 25.15 0.4%
86 5231 14.94 0.2%
88 5365 7.719 0.1%
90 5480 16.82 0.3%
92 5610 11.43 0.2%
94 5702 13.23 0.2%
96 5841 9.496 0.1%
98 5973 13.07 0.2%
100 6066 10.05 0.1%

Quality and confidence:
param error
p 0.025

Model:
Time ~= 47.29
+ p 60.21
µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)

Parity Benchmarking Bot added 2 commits July 13, 2021 20:34
…/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs
@shawntabrizi
Copy link
Member Author

/benchmark runtime pallet pallet_treasury

@parity-benchapp
Copy link

parity-benchapp bot commented Jul 13, 2021

Benchmark Runtime Pallet for branch "shawntabrizi-test-benchmark-bot" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results
Pallet: "pallet_treasury", Extrinsic: "propose_spend", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    42.02
              µs

Reads = 1
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    42.02
              µs

Reads = 1
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "reject_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    39.43
              µs

Reads = 2
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    39.43
              µs

Reads = 2
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "approve_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    13.57
    + p    0.144
              µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    p   mean µs  sigma µs       %
    0     11.43      0.07    0.6%
    1     12.45     0.055    0.4%
    2     12.78     0.065    0.5%
    3     13.25     0.016    0.1%
    4     13.19     0.043    0.3%
    5     13.41     0.044    0.3%
    6     14.23     0.084    0.5%
    7     14.02     0.053    0.3%
    8     14.47     0.044    0.3%
    9     15.04     0.062    0.4%
   10      14.7     0.059    0.4%
   11     15.41     0.083    0.5%
   12     14.93     0.068    0.4%
   13     15.53     0.045    0.2%
   14     15.21     0.039    0.2%
   15     15.46     0.088    0.5%
   16     15.95     0.068    0.4%
   17      15.7      0.06    0.3%
   18     16.26     0.072    0.4%
   19     16.43     0.072    0.4%
   20     16.46     0.123    0.7%
   21     16.94     0.097    0.5%
   22     17.22     0.074    0.4%
   23     17.24     0.091    0.5%
   24     16.87      0.06    0.3%
   25     17.29     0.077    0.4%
   26     17.34     0.096    0.5%
   27     17.59     0.099    0.5%
   28     17.76     0.034    0.1%
   29     17.89     0.077    0.4%
   30     18.09     0.064    0.3%
   31     18.17     0.086    0.4%
   32     18.56     0.056    0.3%
   33     18.63     0.187    1.0%
   34     18.85     0.089    0.4%
   35        19     0.086    0.4%
   36     18.68     0.185    0.9%
   37     19.06      0.15    0.7%
   38     18.83     0.096    0.5%
   39     19.41     0.076    0.3%
   40     19.47     0.076    0.3%
   41      19.7     0.084    0.4%
   42     19.79     0.091    0.4%
   43     20.18     0.073    0.3%
   44     19.99     0.087    0.4%
   45      20.1     0.047    0.2%
   46     20.36     0.091    0.4%
   47     20.57     0.167    0.8%
   48     20.95     0.082    0.3%
   49     21.24     0.101    0.4%
   50     21.43     0.067    0.3%
   51     21.74     0.145    0.6%
   52     21.08      0.11    0.5%
   53      21.5     0.148    0.6%
   54     21.65     0.159    0.7%
   55     22.03     0.142    0.6%
   56     21.75     0.162    0.7%
   57     21.97     0.115    0.5%
   58     21.94     0.131    0.5%
   59     22.42      0.08    0.3%
   60     22.22     0.102    0.4%
   61     22.44     0.107    0.4%
   62     22.82     0.112    0.4%
   63     23.13     0.099    0.4%
   64     22.93      0.19    0.8%
   65     23.13     0.128    0.5%
   66     23.36      0.06    0.2%
   67     23.39     0.088    0.3%
   68      23.5     0.164    0.6%
   69     23.44     0.185    0.7%
   70     23.71     0.172    0.7%
   71        24     0.138    0.5%
   72     23.99     0.207    0.8%
   73     23.93     0.174    0.7%
   74     24.38      0.09    0.3%
   75     23.94     0.066    0.2%
   76     24.29     0.102    0.4%
   77     24.44     0.071    0.2%
   78      24.4     0.082    0.3%
   79     24.58     0.137    0.5%
   80     25.33     0.143    0.5%
   81     25.26     0.169    0.6%
   82      25.3     0.103    0.4%
   83     25.32     0.111    0.4%
   84     25.57     0.131    0.5%
   85     25.32     0.137    0.5%
   86     26.04     0.124    0.4%
   87     25.51     0.104    0.4%
   88     25.95     0.048    0.1%
   89     25.83     0.178    0.6%
   90      26.2     0.108    0.4%
   91      26.2     0.124    0.4%
   92     26.35     0.098    0.3%
   93     26.34     0.122    0.4%
   94     26.73     0.195    0.7%
   95     26.73     0.117    0.4%
   96     27.19     0.171    0.6%
   97     27.89      0.46    1.6%
   98     29.16     0.482    1.6%
   99     27.15     0.129    0.4%

Quality and confidence:
param     error
p             0

Model:
Time ~=    13.44
    + p    0.146
              µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Pallet: "pallet_treasury", Extrinsic: "on_initialize_proposals", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=     58.4
    + p    59.96
              µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    p   mean µs  sigma µs       %
    0     62.08     0.119    0.1%
    2     184.7     0.221    0.1%
    4     302.9     0.568    0.1%
    6     420.8     1.117    0.2%
    8     540.5     1.005    0.1%
   10     662.2     8.722    1.3%
   12     778.7     4.947    0.6%
   14     891.3     1.765    0.1%
   16      1016     8.147    0.8%
   18      1135     4.693    0.4%
   20      1262     12.12    0.9%
   22      1377     13.62    0.9%
   24      1487     8.784    0.5%
   26      1612     14.84    0.9%
   28      1720     9.552    0.5%
   30      1841     7.114    0.3%
   32      1948     1.103    0.0%
   34      2094     11.68    0.5%
   36      2209     11.62    0.5%
   38      2329     13.27    0.5%
   40      2446     10.86    0.4%
   42      2565     8.534    0.3%
   44      2693     8.845    0.3%
   46      2805     9.584    0.3%
   48      2919     16.82    0.5%
   50      3048     12.66    0.4%
   52      3162     10.24    0.3%
   54      3271     8.947    0.2%
   56      3403     9.311    0.2%
   58      3534     12.15    0.3%
   60      3641     11.84    0.3%
   62      3764     10.92    0.2%
   64      3883     6.756    0.1%
   66      4027     9.732    0.2%
   68      4127     9.751    0.2%
   70      4235     11.56    0.2%
   72      4364        16    0.3%
   74      4515     13.65    0.3%
   76      4630     15.06    0.3%
   78      4759     23.39    0.4%
   80      4917     4.196    0.0%
   82      5046     7.071    0.1%
   84      5119     18.42    0.3%
   86      5205     15.81    0.3%
   88      5335     16.07    0.3%
   90      5463     17.27    0.3%
   92      5582     10.44    0.1%
   94      5712      7.84    0.1%
   96      5814     9.707    0.1%
   98      5919     15.11    0.2%
  100      6064     20.52    0.3%

Quality and confidence:
param     error
p         0.031

Model:
Time ~=    49.76
    + p    60.12
              µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)

…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs
@shawntabrizi
Copy link
Member Author

/benchmark runtime pallet pallet_treasury

@parity-benchapp
Copy link

parity-benchapp bot commented Jul 13, 2021

Benchmark Runtime Pallet for branch "shawntabrizi-test-benchmark-bot" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results
Pallet: "pallet_treasury", Extrinsic: "propose_spend", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    41.88
              µs

Reads = 1
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    41.88
              µs

Reads = 1
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "reject_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=       39
              µs

Reads = 2
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=       39
              µs

Reads = 2
Writes = 2
Pallet: "pallet_treasury", Extrinsic: "approve_proposal", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    13.56
    + p    0.146
              µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    p   mean µs  sigma µs       %
    0     11.48     0.072    0.6%
    1     12.29     0.055    0.4%
    2     12.63     0.061    0.4%
    3     13.03     0.065    0.4%
    4     13.22     0.055    0.4%
    5     13.43     0.057    0.4%
    6     14.23     0.062    0.4%
    7     14.05     0.072    0.5%
    8     14.36     0.067    0.4%
    9     15.01     0.046    0.3%
   10     14.57     0.104    0.7%
   11     15.26     0.109    0.7%
   12     14.91     0.048    0.3%
   13     15.38     0.081    0.5%
   14      15.3      0.08    0.5%
   15     15.42     0.066    0.4%
   16     15.76     0.095    0.6%
   17     15.64     0.098    0.6%
   18     16.03     0.096    0.5%
   19     16.29     0.119    0.7%
   20     16.47     0.094    0.5%
   21     16.98     0.075    0.4%
   22     17.17     0.079    0.4%
   23     17.23     0.068    0.3%
   24     16.82     0.093    0.5%
   25     17.55     0.111    0.6%
   26     17.52      0.07    0.3%
   27     17.53     0.085    0.4%
   28     17.76     0.107    0.6%
   29     17.95     0.063    0.3%
   30     18.16     0.058    0.3%
   31     18.15     0.074    0.4%
   32     18.43     0.077    0.4%
   33     18.54     0.082    0.4%
   34     18.93     0.075    0.3%
   35     18.84     0.035    0.1%
   36     18.68     0.066    0.3%
   37     19.26     0.076    0.3%
   38     18.95     0.054    0.2%
   39     19.49      0.07    0.3%
   40     19.72     0.076    0.3%
   41     19.78     0.097    0.4%
   42     19.96     0.087    0.4%
   43     20.28     0.057    0.2%
   44      20.3     0.106    0.5%
   45     20.38     0.124    0.6%
   46     20.45     0.102    0.4%
   47     20.64     0.096    0.4%
   48     21.06     0.078    0.3%
   49     21.27     0.079    0.3%
   50     21.66     0.116    0.5%
   51     21.95     0.167    0.7%
   52     21.18     0.098    0.4%
   53     21.42     0.033    0.1%
   54     21.73     0.226    1.0%
   55     21.93     0.069    0.3%
   56     21.79     0.126    0.5%
   57     22.11     0.099    0.4%
   58     22.16      0.09    0.4%
   59     22.52     0.071    0.3%
   60     22.47     0.183    0.8%
   61     22.49     0.133    0.5%
   62     22.56     0.047    0.2%
   63     22.93     0.103    0.4%
   64     23.28      0.12    0.5%
   65        23      0.09    0.3%
   66     23.43     0.076    0.3%
   67     23.47     0.149    0.6%
   68     23.54     0.106    0.4%
   69      23.6     0.095    0.4%
   70      23.9     0.151    0.6%
   71     24.33       0.1    0.4%
   72     24.09      0.07    0.2%
   73        24     0.064    0.2%
   74     24.66     0.075    0.3%
   75     24.41     0.114    0.4%
   76     24.48     0.113    0.4%
   77     24.54     0.147    0.5%
   78      24.6     0.114    0.4%
   79     24.83     0.084    0.3%
   80      25.3     0.099    0.3%
   81     25.55     0.069    0.2%
   82     25.58     0.086    0.3%
   83     25.48     0.179    0.7%
   84     25.91      0.08    0.3%
   85     25.62     0.152    0.5%
   86     26.42     0.098    0.3%
   87     25.81     0.112    0.4%
   88     26.13     0.089    0.3%
   89     25.93     0.126    0.4%
   90     26.26     0.159    0.6%
   91     26.55     0.086    0.3%
   92     26.47      0.13    0.4%
   93     26.54     0.157    0.5%
   94     26.62     0.211    0.7%
   95     26.69     0.081    0.3%
   96     27.23     0.128    0.4%
   97     27.06     0.126    0.4%
   98     27.62     0.174    0.6%
   99     27.39     0.148    0.5%

Quality and confidence:
param     error
p             0

Model:
Time ~=    13.42
    + p    0.147
              µs

Reads = 2 + (0 * p)
Writes = 1 + (0 * p)
Pallet: "pallet_treasury", Extrinsic: "on_initialize_proposals", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    57.42
    + p    59.78
              µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    p   mean µs  sigma µs       %
    0     61.96     0.112    0.1%
    2     183.7     0.256    0.1%
    4     299.9     0.386    0.1%
    6     417.6      0.47    0.1%
    8     536.3     0.347    0.0%
   10     653.3     1.335    0.2%
   12     771.8     0.916    0.1%
   14       889     0.785    0.0%
   16      1006     2.174    0.2%
   18      1130     2.198    0.1%
   20      1244     4.589    0.3%
   22      1372     10.39    0.7%
   24      1481     1.588    0.1%
   26      1608     15.29    0.9%
   28      1725     13.19    0.7%
   30      1833     3.194    0.1%
   32      1969     11.38    0.5%
   34      2082      13.6    0.6%
   36      2205     15.04    0.6%
   38      2326     12.58    0.5%
   40      2447      15.8    0.6%
   42      2549     13.78    0.5%
   44      2685     13.65    0.5%
   46      2809     11.36    0.4%
   48      2917     16.27    0.5%
   50      3037     11.99    0.3%
   52      3163     9.784    0.3%
   54      3279     10.18    0.3%
   56      3397     23.21    0.6%
   58      3510     11.08    0.3%
   60      3627     16.38    0.4%
   62      3743     5.585    0.1%
   64      3885     11.07    0.2%
   66      4006     9.288    0.2%
   68      4107      9.92    0.2%
   70      4220      13.4    0.3%
   72      4352     13.26    0.3%
   74      4504      10.9    0.2%
   76      4611     5.744    0.1%
   78      4732     11.92    0.2%
   80      4899     31.28    0.6%
   82      5146     50.59    0.9%
   84      5125     24.66    0.4%
   86      5183     9.657    0.1%
   88      5317     13.26    0.2%
   90      5434     14.16    0.2%
   92      5560     3.684    0.0%
   94      5697     14.82    0.2%
   96      5810     15.78    0.2%
   98      5902     13.11    0.2%
  100      6038     11.37    0.1%

Quality and confidence:
param     error
p         0.048

Model:
Time ~=    47.64
    + p    60.03
              µs

Reads = 2 + (3 * p)
Writes = 2 + (3 * p)

…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_treasury --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/treasury/src/weights.rs --template=./.maintain/frame-weight-template.hbs
@stale
Copy link

stale bot commented Aug 12, 2021

Hey, is anyone still working on this? Due to the inactivity this issue has been automatically marked as stale. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the A5-stale Pull request did not receive any updates in a long time. No review needed at this stage. Close it. label Aug 12, 2021
@shawntabrizi shawntabrizi deleted the shawntabrizi-test-benchmark-bot branch August 13, 2021 15:19
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
A3-in_progress Pull request is in progress. No review needed at this stage. A5-stale Pull request did not receive any updates in a long time. No review needed at this stage. Close it.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants