Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clean up benchmark code #526

Merged
merged 1 commit into from
Oct 20, 2022
Merged

Clean up benchmark code #526

merged 1 commit into from
Oct 20, 2022

Conversation

Robbepop
Copy link
Member

No description provided.

@paritytech-cicd-pr
Copy link

BENCHMARKS

NATIVEWASMTIME
BENCHMARKMASTERPRDIFFMASTERPRDIFFWASMTIME OVERHEAD
execute/
bare_call_0
1.28ms 1.29ms ⚪ 0.26% 1.08ms 1.12ms 🔴 4.21% 🟢 -13%
execute/
bare_call_0/typed
704.36µs 704.11µs ⚪ -0.07% 531.94µs 530.45µs ⚪ -0.64% 🟢 -25%
execute/
bare_call_1
1.39ms 1.39ms ⚪ 0.02% 1.37ms 1.34ms 🟢 -1.88% 🟢 -3%
execute/
bare_call_16
3.08ms 3.06ms ⚪ -0.29% 4.86ms 4.86ms ⚪ 0.09% 🟡 59%
execute/
bare_call_16/typed
1.29ms 1.29ms ⚪ 0.24% 2.51ms 2.51ms ⚪ -0.26% 🟡 94%
execute/
bare_call_1/typed
802.23µs 799.20µs ⚪ -0.34% 863.80µs 811.70µs 🟢 -5.94% 🟢 2%
execute/
bare_call_4
1.77ms 1.78ms ⚪ 0.09% 2.07ms 2.14ms 🔴 3.42% 🟢 20%
execute/
bare_call_4/typed
887.04µs 887.38µs ⚪ -0.14% 1.00ms 983.97µs 🟢 -1.83% 🟢 11%
execute/
br_table
920.47µs 917.67µs ⚪ -0.29% 1.06ms 1.06ms ⚪ 0.10% 🟢 16%
execute/
count_until
937.29µs 888.42µs 🟢 -4.98% 2.28ms 2.28ms ⚪ -0.28% 🔴 156%
execute/
factorial_iterative
363.97µs 365.15µs ⚪ 0.19% 922.27µs 922.10µs ⚪ 0.03% 🔴 153%
execute/
factorial_recursive
759.16µs 766.71µs ⚪ 0.93% 1.56ms 1.56ms ⚪ -0.16% 🔴 103%
execute/
fib_iterative
1.79ms 1.79ms ⚪ 0.00% 4.94ms 5.03ms 🔴 1.67% 🔴 181%
execute/
fib_recursive
7.16ms 7.17ms ⚪ 0.22% 14.55ms 14.78ms 🔴 1.58% 🔴 106%
execute/
global_bump
1.45ms 1.46ms ⚪ 1.08% 3.58ms 3.58ms ⚪ -0.15% 🔴 145%
execute/
host_calls
32.38µs 32.34µs ⚪ 0.31% 45.08µs 45.76µs 🔴 1.74% 🟢 42%
execute/
memory_fill
1.53ms 1.54ms ⚪ 0.04% 4.13ms 4.13ms ⚪ 0.01% 🔴 169%
execute/
memory_sum
1.62ms 1.62ms ⚪ -3.85% 4.15ms 4.15ms ⚪ 0.06% 🔴 156%
execute/
memory_vec_add
3.02ms 3.03ms ⚪ 0.13% 8.77ms 8.75ms ⚪ -0.22% 🔴 189%
execute/
recursive_is_even
1.31ms 1.31ms ⚪ -0.21% 2.71ms 2.61ms ⚪ -4.04% 🟡 99%
execute/
recursive_ok
177.75µs 175.87µs ⚪ -0.92% 359.02µs 360.04µs ⚪ 0.28% 🔴 105%
execute/
recursive_scan
222.14µs 220.16µs ⚪ -0.88% 467.06µs 467.70µs ⚪ 0.18% 🔴 112%
execute/
recursive_trap
18.10µs 18.72µs 🔴 3.90% 35.84µs 35.97µs ⚪ 0.17% 🟡 92%
execute/
regex_redux
657.47µs 659.21µs ⚪ 0.38% 1.61ms 1.66ms 🔴 2.93% 🔴 152%
execute/
rev_complement
586.32µs 597.96µs 🔴 1.87% 1.53ms 1.52ms ⚪ -0.10% 🔴 155%
execute/
tiny_keccak
457.57µs 446.98µs 🟢 -2.46% 1.48ms 1.41ms 🟢 -4.63% 🔴 216%
execute/
trunc_f2i
1.07ms 1.07ms ⚪ -0.02% 2.62ms 2.61ms ⚪ -0.39% 🔴 144%
instantiate/
wasm_kernel
71.54µs 70.52µs ⚪ -2.51% 126.41µs 124.65µs 🟢 -1.47% 🟡 77%
translate/
wasm_kernel
4.83ms 4.83ms ⚪ -0.30% 9.79ms 9.74ms ⚪ -0.66% 🔴 102%

Link to pipeline

@Robbepop Robbepop merged commit 1e487d2 into master Oct 20, 2022
@Robbepop Robbepop deleted the rf-cleanup-benchmarks branch October 20, 2022 11:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants