Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chores: Improve fuzz testing infrastructure and add docs #529

Merged
merged 2 commits into from
Oct 21, 2022

Conversation

Robbepop
Copy link
Member

No description provided.

@paritytech-cicd-pr
Copy link

BENCHMARKS

NATIVEWASMTIME
BENCHMARKMASTERPRDIFFMASTERPRDIFFWASMTIME OVERHEAD
execute/
bare_call_0
1.28ms 1.27ms ⚪ -0.58% 1.11ms 1.11ms 🔴 0.36% 🟢 -13%
execute/
bare_call_0/typed
704.84µs 710.81µs ⚪ 0.82% 525.74µs 544.00µs 🔴 3.49% 🟢 -23%
execute/
bare_call_1
1.41ms 1.40ms 🔴 -0.10% 1.36ms 1.43ms 🔴 5.34% 🟢 2%
execute/
bare_call_16
2.98ms 2.98ms 🔴 -0.30% 5.16ms 5.21ms 🔴 0.83% 🟡 75%
execute/
bare_call_16/typed
1.28ms 1.30ms 🔴 1.29% 2.37ms 2.40ms 🔴 1.56% 🟡 85%
execute/
bare_call_1/typed
805.51µs 909.36µs 🔴 12.83% 872.48µs 875.92µs ⚪ 0.40% 🟢 -4%
execute/
bare_call_4
1.75ms 1.75ms ⚪ 0.05% 2.14ms 2.16ms 🔴 0.94% 🟢 23%
execute/
bare_call_4/typed
889.69µs 897.09µs ⚪ 0.96% 986.02µs 1.02ms 🔴 3.72% 🟢 14%
execute/
br_table
920.07µs 934.87µs 🔴 1.54% 1.10ms 1.13ms 🔴 2.48% 🟢 21%
execute/
count_until
902.73µs 903.30µs ⚪ 0.10% 2.33ms 2.72ms 🔴 16.93% 🔴 202%
execute/
factorial_iterative
364.03µs 364.26µs ⚪ 0.06% 927.70µs 927.93µs ⚪ -0.09% 🔴 155%
execute/
factorial_recursive
719.32µs 737.74µs 🔴 2.65% 1.54ms 1.53ms ⚪ -0.21% 🔴 108%
execute/
fib_iterative
1.79ms 1.79ms ⚪ 0.09% 5.03ms 5.03ms ⚪ 0.03% 🔴 181%
execute/
fib_recursive
8.17ms 8.25ms ⚪ 0.88% 14.13ms 14.24ms ⚪ 0.79% 🟡 73%
execute/
global_bump
1.36ms 1.36ms ⚪ 0.06% 3.65ms 3.64ms ⚪ -0.15% 🔴 167%
execute/
host_calls
33.48µs 32.67µs ⚪ -1.10% 44.39µs 44.39µs ⚪ -0.03% 🟢 36%
execute/
memory_fill
1.55ms 1.56ms ⚪ 0.22% 4.23ms 4.22ms ⚪ -0.14% 🔴 171%
execute/
memory_sum
1.55ms 1.55ms ⚪ 0.05% 4.25ms 4.24ms ⚪ -0.17% 🔴 173%
execute/
memory_vec_add
3.06ms 3.06ms ⚪ 0.00% 8.65ms 8.66ms ⚪ 0.10% 🔴 183%
execute/
recursive_is_even
1.30ms 1.30ms ⚪ 0.00% 2.59ms 2.59ms ⚪ 0.07% 🟡 100%
execute/
recursive_ok
170.88µs 171.21µs ⚪ 0.18% 362.02µs 362.08µs ⚪ 0.04% 🔴 111%
execute/
recursive_scan
215.15µs 214.98µs ⚪ 0.02% 464.54µs 465.26µs ⚪ 0.12% 🔴 116%
execute/
recursive_trap
17.03µs 16.99µs ⚪ 0.05% 36.28µs 36.39µs ⚪ 0.26% 🔴 114%
execute/
regex_redux
674.71µs 720.10µs 🔴 6.61% 1.59ms 1.59ms ⚪ -0.17% 🔴 120%
execute/
rev_complement
594.06µs 593.43µs ⚪ 0.05% 1.54ms 1.53ms ⚪ -0.71% 🔴 157%
execute/
tiny_keccak
478.22µs 463.04µs 🟢 -3.30% 1.37ms 1.36ms ⚪ -0.60% 🔴 194%
execute/
trunc_f2i
1.08ms 1.08ms ⚪ 0.02% 2.65ms 2.64ms ⚪ -0.06% 🔴 146%
instantiate/
wasm_kernel
72.26µs 72.45µs ⚪ 0.61% 120.78µs 121.02µs ⚪ -0.09% 🟡 67%
translate/
wasm_kernel
4.18ms 4.21ms ⚪ 0.54% 7.81ms 7.80ms ⚪ -0.21% 🟡 86%

Link to pipeline

@Robbepop Robbepop merged commit 3a591c8 into master Oct 21, 2022
@Robbepop Robbepop deleted the rf-chores-fuzz branch October 21, 2022 12:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants