Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

test: update web3signer e2e tests to verify deneb signatures #6630

Merged
merged 1 commit into from
Apr 5, 2024
Merged

test: update web3signer e2e tests to verify deneb signatures #6630

merged 1 commit into from
Apr 5, 2024

Conversation

nflaig
Copy link
Member

@nflaig nflaig commented Apr 4, 2024 •
edited
Loading

Motivation

Ensure we are compatible with latest web3signer version and verify deneb signatures

Description

  • update web3signer to latest version (v24.2.0)
  • verify deneb block signatures

@nflaig nflaig requested a review from a team as a code owner April 4, 2024 16:52
@codecov Codecov
Copy link

codecov bot commented Apr 4, 2024 •
edited
Loading

Codecov Report

Merging #6630 (b6ee93c) into unstable (2ee8ac6) will not change coverage.
The diff coverage is n/a.

❗ Current head b6ee93c differs from pull request most recent head 100d1f5. Consider uploading reports for the commit 100d1f5 to get more accurate results

Additional details and impacted files 
@@            Coverage Diff            @@
##           unstable    #6630   +/-   ##
=========================================
  Coverage     61.69%   61.69%           
=========================================
  Files           556      556           
  Lines         58820    58820           
  Branches       1887     1887           
=========================================
  Hits          36287    36287           
  Misses        22492    22492           
  Partials         41       41

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 4, 2024

Performance Report

✔️ no performance regression detected

🚀🚀 Significant benchmark improvement detected

Benchmark suite Current: af6f712 Previous: fd6691d Ratio
Object set x1000 28.214 ns/op 100.30 ns/op 0.28
Map set x1000 18.672 ns/op 70.250 ns/op 0.27
fastMsgIdFn sha256 / 10000 bytes 53.675 us/op 174.49 us/op 0.31
send data - 1000 256B messages 10.207 ms/op 38.742 ms/op 0.26
Set add up to 64 items then delete first 1.8160 us/op 6.0431 us/op 0.30
Set add up to 64 items then delete last 2.0122 us/op 6.4691 us/op 0.31
Set add up to 64 items then delete middle 2.0083 us/op 6.3289 us/op 0.32
Set add up to 128 items then delete middle 3.8508 us/op 13.026 us/op 0.30
Set add up to 256 items then delete first 8.4110 us/op 29.035 us/op 0.29
OrderedSet add up to 256 items then delete first 11.541 us/op 43.119 us/op 0.27
Set add up to 256 items then delete middle 7.5441 us/op 25.384 us/op 0.30
forkChoice updateHead vc 600000 bc 64 eq 300000 12.201 ms/op 64.066 ms/op 0.19
Full benchmark results
Benchmark suite Current: af6f712 Previous: fd6691d Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 500.06 us/op 620.81 us/op 0.81
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 63.791 us/op 107.81 us/op 0.59
BLS verify - blst-native 1.1355 ms/op 1.3942 ms/op 0.81
BLS verifyMultipleSignatures 3 - blst-native 2.3691 ms/op 3.1441 ms/op 0.75
BLS verifyMultipleSignatures 8 - blst-native 5.3021 ms/op 6.5104 ms/op 0.81
BLS verifyMultipleSignatures 32 - blst-native 19.368 ms/op 26.131 ms/op 0.74
BLS verifyMultipleSignatures 64 - blst-native 38.177 ms/op 47.474 ms/op 0.80
BLS verifyMultipleSignatures 128 - blst-native 75.879 ms/op 98.966 ms/op 0.77
BLS deserializing 10000 signatures 812.48 ms/op 1.0072 s/op 0.81
BLS deserializing 100000 signatures 8.3438 s/op 9.6488 s/op 0.86
BLS verifyMultipleSignatures - same message - 3 - blst-native 1.1412 ms/op 1.4968 ms/op 0.76
BLS verifyMultipleSignatures - same message - 8 - blst-native 1.2901 ms/op 1.5765 ms/op 0.82
BLS verifyMultipleSignatures - same message - 32 - blst-native 2.0800 ms/op 2.5795 ms/op 0.81
BLS verifyMultipleSignatures - same message - 64 - blst-native 4.1572 ms/op 3.7614 ms/op 1.11
BLS verifyMultipleSignatures - same message - 128 - blst-native 5.0281 ms/op 6.0682 ms/op 0.83
BLS aggregatePubkeys 32 - blst-native 23.159 us/op 28.191 us/op 0.82
BLS aggregatePubkeys 128 - blst-native 90.697 us/op 109.45 us/op 0.83
notSeenSlots=1 numMissedVotes=1 numBadVotes=10 65.295 ms/op 65.792 ms/op 0.99
notSeenSlots=1 numMissedVotes=0 numBadVotes=4 59.508 ms/op 73.319 ms/op 0.81
notSeenSlots=2 numMissedVotes=1 numBadVotes=10 28.803 ms/op 52.892 ms/op 0.54
getSlashingsAndExits - default max 244.32 us/op 277.47 us/op 0.88
getSlashingsAndExits - 2k 359.69 us/op 750.06 us/op 0.48
proposeBlockBody type=full, size=empty 4.6325 ms/op 7.8813 ms/op 0.59
isKnown best case - 1 super set check 352.00 ns/op 676.00 ns/op 0.52
isKnown normal case - 2 super set checks 402.00 ns/op 739.00 ns/op 0.54
isKnown worse case - 16 super set checks 533.00 ns/op 940.00 ns/op 0.57
InMemoryCheckpointStateCache - add get delete 6.3240 us/op 11.012 us/op 0.57
validate api signedAggregateAndProof - struct 2.4838 ms/op 3.5494 ms/op 0.70
validate gossip signedAggregateAndProof - struct 2.4909 ms/op 3.3227 ms/op 0.75
validate gossip attestation - vc 640000 1.1715 ms/op 1.6288 ms/op 0.72
batch validate gossip attestation - vc 640000 - chunk 32 144.58 us/op 217.56 us/op 0.66
batch validate gossip attestation - vc 640000 - chunk 64 125.03 us/op 193.27 us/op 0.65
batch validate gossip attestation - vc 640000 - chunk 128 119.52 us/op 173.35 us/op 0.69
batch validate gossip attestation - vc 640000 - chunk 256 112.29 us/op 169.36 us/op 0.66
pickEth1Vote - no votes 965.58 us/op 1.6141 ms/op 0.60
pickEth1Vote - max votes 9.3436 ms/op 13.899 ms/op 0.67
pickEth1Vote - Eth1Data hashTreeRoot value x2048 15.500 ms/op 22.616 ms/op 0.69
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 26.310 ms/op 29.658 ms/op 0.89
pickEth1Vote - Eth1Data fastSerialize value x2048 563.54 us/op 803.84 us/op 0.70
pickEth1Vote - Eth1Data fastSerialize tree x2048 6.1404 ms/op 6.9345 ms/op 0.89
bytes32 toHexString 945.00 ns/op 937.00 ns/op 1.01
bytes32 Buffer.toString(hex) 405.00 ns/op 390.00 ns/op 1.04
bytes32 Buffer.toString(hex) from Uint8Array 545.00 ns/op 616.00 ns/op 0.88
bytes32 Buffer.toString(hex) + 0x 403.00 ns/op 350.00 ns/op 1.15
Object access 1 prop 0.23600 ns/op 0.24100 ns/op 0.98
Map access 1 prop 0.21100 ns/op 0.19300 ns/op 1.09
Object get x1000 5.5370 ns/op 8.3760 ns/op 0.66
Map get x1000 0.79400 ns/op 1.0780 ns/op 0.74
Object set x1000 28.214 ns/op 100.30 ns/op 0.28
Map set x1000 18.672 ns/op 70.250 ns/op 0.27
Return object 10000 times 0.24180 ns/op 0.41810 ns/op 0.58
Throw Error 10000 times 2.8253 us/op 4.8362 us/op 0.58
fastMsgIdFn sha256 / 200 bytes 2.1540 us/op 4.2730 us/op 0.50
fastMsgIdFn h32 xxhash / 200 bytes 316.00 ns/op 454.00 ns/op 0.70
fastMsgIdFn h64 xxhash / 200 bytes 362.00 ns/op 624.00 ns/op 0.58
fastMsgIdFn sha256 / 1000 bytes 6.5150 us/op 14.700 us/op 0.44
fastMsgIdFn h32 xxhash / 1000 bytes 460.00 ns/op 632.00 ns/op 0.73
fastMsgIdFn h64 xxhash / 1000 bytes 489.00 ns/op 724.00 ns/op 0.68
fastMsgIdFn sha256 / 10000 bytes 53.675 us/op 174.49 us/op 0.31
fastMsgIdFn h32 xxhash / 10000 bytes 1.9160 us/op 3.9450 us/op 0.49
fastMsgIdFn h64 xxhash / 10000 bytes 1.3270 us/op 2.6280 us/op 0.50
send data - 1000 256B messages 10.207 ms/op 38.742 ms/op 0.26
send data - 1000 512B messages 15.888 ms/op 34.250 ms/op 0.46
send data - 1000 1024B messages 23.878 ms/op 47.836 ms/op 0.50
send data - 1000 1200B messages 32.176 ms/op 52.835 ms/op 0.61
send data - 1000 2048B messages 38.913 ms/op 73.144 ms/op 0.53
send data - 1000 4096B messages 35.486 ms/op 62.922 ms/op 0.56
send data - 1000 16384B messages 98.466 ms/op 186.56 ms/op 0.53
send data - 1000 65536B messages 440.94 ms/op 491.11 ms/op 0.90
enrSubnets - fastDeserialize 64 bits 1.1510 us/op 2.0590 us/op 0.56
enrSubnets - ssz BitVector 64 bits 547.00 ns/op 616.00 ns/op 0.89
enrSubnets - fastDeserialize 4 bits 291.00 ns/op 278.00 ns/op 1.05
enrSubnets - ssz BitVector 4 bits 570.00 ns/op 695.00 ns/op 0.82
prioritizePeers score -10:0 att 32-0.1 sync 2-0 85.517 us/op 132.12 us/op 0.65
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 101.19 us/op 176.13 us/op 0.57
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 141.60 us/op 266.88 us/op 0.53
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 212.11 us/op 432.31 us/op 0.49
prioritizePeers score 0:0 att 64-1 sync 4-1 231.88 us/op 456.10 us/op 0.51
array of 16000 items push then shift 1.3482 us/op 2.1317 us/op 0.63
LinkedList of 16000 items push then shift 6.2290 ns/op 10.848 ns/op 0.57
array of 16000 items push then pop 91.060 ns/op 138.36 ns/op 0.66
LinkedList of 16000 items push then pop 6.8000 ns/op 10.310 ns/op 0.66
array of 24000 items push then shift 1.9066 us/op 2.7793 us/op 0.69
LinkedList of 24000 items push then shift 7.0450 ns/op 11.922 ns/op 0.59
array of 24000 items push then pop 146.48 ns/op 185.30 ns/op 0.79
LinkedList of 24000 items push then pop 6.1370 ns/op 11.043 ns/op 0.56
intersect bitArray bitLen 8 5.8270 ns/op 7.2550 ns/op 0.80
intersect array and set length 8 50.066 ns/op 125.45 ns/op 0.40
intersect bitArray bitLen 128 29.573 ns/op 43.679 ns/op 0.68
intersect array and set length 128 726.73 ns/op 1.2057 us/op 0.60
bitArray.getTrueBitIndexes() bitLen 128 1.1560 us/op 2.1220 us/op 0.54
bitArray.getTrueBitIndexes() bitLen 248 1.8110 us/op 4.0590 us/op 0.45
bitArray.getTrueBitIndexes() bitLen 512 3.7110 us/op 7.8210 us/op 0.47
Buffer.concat 32 items 842.00 ns/op 1.3860 us/op 0.61
Uint8Array.set 32 items 1.5520 us/op 2.4530 us/op 0.63
Set add up to 64 items then delete first 1.8160 us/op 6.0431 us/op 0.30
OrderedSet add up to 64 items then delete first 2.7098 us/op 8.0651 us/op 0.34
Set add up to 64 items then delete last 2.0122 us/op 6.4691 us/op 0.31
OrderedSet add up to 64 items then delete last 3.1861 us/op 8.6411 us/op 0.37
Set add up to 64 items then delete middle 2.0083 us/op 6.3289 us/op 0.32
OrderedSet add up to 64 items then delete middle 5.0648 us/op 9.5873 us/op 0.53
Set add up to 128 items then delete first 4.2611 us/op 12.241 us/op 0.35
OrderedSet add up to 128 items then delete first 6.4399 us/op 16.568 us/op 0.39
Set add up to 128 items then delete last 4.1673 us/op 11.956 us/op 0.35
OrderedSet add up to 128 items then delete last 6.5976 us/op 17.125 us/op 0.39
Set add up to 128 items then delete middle 3.8508 us/op 13.026 us/op 0.30
OrderedSet add up to 128 items then delete middle 12.394 us/op 23.700 us/op 0.52
Set add up to 256 items then delete first 8.4110 us/op 29.035 us/op 0.29
OrderedSet add up to 256 items then delete first 11.541 us/op 43.119 us/op 0.27
Set add up to 256 items then delete last 8.8725 us/op 25.406 us/op 0.35
OrderedSet add up to 256 items then delete last 12.576 us/op 34.257 us/op 0.37
Set add up to 256 items then delete middle 7.5441 us/op 25.384 us/op 0.30
OrderedSet add up to 256 items then delete middle 36.508 us/op 57.852 us/op 0.63
transfer serialized Status (84 B) 1.5480 us/op 2.5400 us/op 0.61
copy serialized Status (84 B) 1.1580 us/op 1.8790 us/op 0.62
transfer serialized SignedVoluntaryExit (112 B) 1.4850 us/op 2.7600 us/op 0.54
copy serialized SignedVoluntaryExit (112 B) 1.1220 us/op 2.0820 us/op 0.54
transfer serialized ProposerSlashing (416 B) 1.5890 us/op 3.1190 us/op 0.51
copy serialized ProposerSlashing (416 B) 1.4530 us/op 2.5910 us/op 0.56
transfer serialized Attestation (485 B) 1.5950 us/op 3.3310 us/op 0.48
copy serialized Attestation (485 B) 1.4540 us/op 3.6480 us/op 0.40
transfer serialized AttesterSlashing (33232 B) 1.6470 us/op 3.9440 us/op 0.42
copy serialized AttesterSlashing (33232 B) 3.5500 us/op 11.816 us/op 0.30
transfer serialized Small SignedBeaconBlock (128000 B) 1.8400 us/op 3.5300 us/op 0.52
copy serialized Small SignedBeaconBlock (128000 B) 9.0580 us/op 46.639 us/op 0.19
transfer serialized Avg SignedBeaconBlock (200000 B) 1.8260 us/op 6.6640 us/op 0.27
copy serialized Avg SignedBeaconBlock (200000 B) 14.473 us/op 58.587 us/op 0.25
transfer serialized BlobsSidecar (524380 B) 3.4650 us/op 7.6910 us/op 0.45
copy serialized BlobsSidecar (524380 B) 148.79 us/op 171.73 us/op 0.87
transfer serialized Big SignedBeaconBlock (1000000 B) 3.4080 us/op 8.3190 us/op 0.41
copy serialized Big SignedBeaconBlock (1000000 B) 186.46 us/op 310.73 us/op 0.60
pass gossip attestations to forkchoice per slot 2.6117 ms/op 7.1140 ms/op 0.37
forkChoice updateHead vc 100000 bc 64 eq 0 437.72 us/op 779.40 us/op 0.56
forkChoice updateHead vc 600000 bc 64 eq 0 2.8372 ms/op 5.4028 ms/op 0.53
forkChoice updateHead vc 1000000 bc 64 eq 0 4.5451 ms/op 10.002 ms/op 0.45
forkChoice updateHead vc 600000 bc 320 eq 0 2.6357 ms/op 5.0206 ms/op 0.52
forkChoice updateHead vc 600000 bc 1200 eq 0 2.8485 ms/op 5.1224 ms/op 0.56
forkChoice updateHead vc 600000 bc 7200 eq 0 3.9070 ms/op 6.8263 ms/op 0.57
forkChoice updateHead vc 600000 bc 64 eq 1000 9.9864 ms/op 13.014 ms/op 0.77
forkChoice updateHead vc 600000 bc 64 eq 10000 11.089 ms/op 14.504 ms/op 0.76
forkChoice updateHead vc 600000 bc 64 eq 300000 12.201 ms/op 64.066 ms/op 0.19
computeDeltas 500000 validators 300 proto nodes 3.2890 ms/op 8.4159 ms/op 0.39
computeDeltas 500000 validators 1200 proto nodes 3.1321 ms/op 8.4437 ms/op 0.37
computeDeltas 500000 validators 7200 proto nodes 3.1777 ms/op 8.2029 ms/op 0.39
computeDeltas 750000 validators 300 proto nodes 4.6971 ms/op 11.612 ms/op 0.40
computeDeltas 750000 validators 1200 proto nodes 4.8989 ms/op 11.593 ms/op 0.42
computeDeltas 750000 validators 7200 proto nodes 5.0089 ms/op 11.701 ms/op 0.43
computeDeltas 1400000 validators 300 proto nodes 9.4637 ms/op 23.557 ms/op 0.40
computeDeltas 1400000 validators 1200 proto nodes 10.908 ms/op 23.622 ms/op 0.46
computeDeltas 1400000 validators 7200 proto nodes 10.244 ms/op 23.793 ms/op 0.43
computeDeltas 2100000 validators 300 proto nodes 14.346 ms/op 35.436 ms/op 0.40
computeDeltas 2100000 validators 1200 proto nodes 16.119 ms/op 35.514 ms/op 0.45
computeDeltas 2100000 validators 7200 proto nodes 15.961 ms/op 31.682 ms/op 0.50
altair processAttestation - 250000 vs - 7PWei normalcase 4.4660 ms/op 4.5917 ms/op 0.97
altair processAttestation - 250000 vs - 7PWei worstcase 4.6061 ms/op 5.5144 ms/op 0.84
altair processAttestation - setStatus - 1/6 committees join 152.60 us/op 192.79 us/op 0.79
altair processAttestation - setStatus - 1/3 committees join 301.29 us/op 366.63 us/op 0.82
altair processAttestation - setStatus - 1/2 committees join 337.31 us/op 489.43 us/op 0.69
altair processAttestation - setStatus - 2/3 committees join 444.59 us/op 661.16 us/op 0.67
altair processAttestation - setStatus - 4/5 committees join 561.58 us/op 831.62 us/op 0.68
altair processAttestation - setStatus - 100% committees join 625.35 us/op 1.0683 ms/op 0.59
altair processBlock - 250000 vs - 7PWei normalcase 10.560 ms/op 12.609 ms/op 0.84
altair processBlock - 250000 vs - 7PWei normalcase hashState 40.932 ms/op 40.651 ms/op 1.01
altair processBlock - 250000 vs - 7PWei worstcase 42.003 ms/op 48.478 ms/op 0.87
altair processBlock - 250000 vs - 7PWei worstcase hashState 91.660 ms/op 121.80 ms/op 0.75
phase0 processBlock - 250000 vs - 7PWei normalcase 4.0890 ms/op 3.7135 ms/op 1.10
phase0 processBlock - 250000 vs - 7PWei worstcase 35.939 ms/op 40.072 ms/op 0.90
altair processEth1Data - 250000 vs - 7PWei normalcase 703.82 us/op 892.37 us/op 0.79
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15 24.140 us/op 16.627 us/op 1.45
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219 113.46 us/op 96.683 us/op 1.17
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42 47.716 us/op 28.957 us/op 1.65
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18 32.735 us/op 23.204 us/op 1.41
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020 245.94 us/op 236.10 us/op 1.04
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777 2.4026 ms/op 1.9424 ms/op 1.24
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384 2.2934 ms/op 2.8291 ms/op 0.81
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384 1.6798 ms/op 2.6506 ms/op 0.63
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384 6.1037 ms/op 5.1315 ms/op 1.19
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384 3.0523 ms/op 4.4900 ms/op 0.68
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384 14.151 ms/op 6.9666 ms/op 2.03
Tree 40 250000 create 960.11 ms/op 688.80 ms/op 1.39
Tree 40 250000 get(125000) 142.48 ns/op 228.25 ns/op 0.62
Tree 40 250000 set(125000) 2.3739 us/op 1.7505 us/op 1.36
Tree 40 250000 toArray() 28.606 ms/op 28.251 ms/op 1.01
Tree 40 250000 iterate all - toArray() + loop 27.211 ms/op 29.680 ms/op 0.92
Tree 40 250000 iterate all - get(i) 68.577 ms/op 88.023 ms/op 0.78
MutableVector 250000 create 19.870 ms/op 19.451 ms/op 1.02
MutableVector 250000 get(125000) 6.8080 ns/op 7.3000 ns/op 0.93
MutableVector 250000 set(125000) 789.32 ns/op 424.81 ns/op 1.86
MutableVector 250000 toArray() 5.6122 ms/op 4.4063 ms/op 1.27
MutableVector 250000 iterate all - toArray() + loop 5.9539 ms/op 4.6880 ms/op 1.27
MutableVector 250000 iterate all - get(i) 1.4989 ms/op 1.6428 ms/op 0.91
Array 250000 create 5.4195 ms/op 3.9965 ms/op 1.36
Array 250000 clone - spread 9.4742 ms/op 1.7635 ms/op 5.37
Array 250000 get(125000) 4.4440 ns/op 1.8270 ns/op 2.43
Array 250000 set(125000) 3.8690 ns/op 6.0650 ns/op 0.64
Array 250000 iterate all - loop 169.86 us/op 184.78 us/op 0.92
effectiveBalanceIncrements clone Uint8Array 300000 87.113 us/op 68.796 us/op 1.27
effectiveBalanceIncrements clone MutableVector 300000 2.8180 us/op 538.00 ns/op 5.24
effectiveBalanceIncrements rw all Uint8Array 300000 216.68 us/op 215.28 us/op 1.01
effectiveBalanceIncrements rw all MutableVector 300000 294.47 ms/op 159.11 ms/op 1.85
phase0 afterProcessEpoch - 250000 vs - 7PWei 107.72 ms/op 124.58 ms/op 0.86
phase0 beforeProcessEpoch - 250000 vs - 7PWei 65.122 ms/op 63.209 ms/op 1.03
altair processEpoch - mainnet_e81889 640.14 ms/op 575.03 ms/op 1.11
mainnet_e81889 - altair beforeProcessEpoch 144.89 ms/op 103.16 ms/op 1.40
mainnet_e81889 - altair processJustificationAndFinalization 30.568 us/op 19.593 us/op 1.56
mainnet_e81889 - altair processInactivityUpdates 13.132 ms/op 6.7600 ms/op 1.94
mainnet_e81889 - altair processRewardsAndPenalties 71.829 ms/op 65.148 ms/op 1.10
mainnet_e81889 - altair processRegistryUpdates 2.9590 us/op 4.1800 us/op 0.71
mainnet_e81889 - altair processSlashings 664.00 ns/op 675.00 ns/op 0.98
mainnet_e81889 - altair processEth1DataReset 987.00 ns/op 855.00 ns/op 1.15
mainnet_e81889 - altair processEffectiveBalanceUpdates 1.2020 ms/op 1.4614 ms/op 0.82
mainnet_e81889 - altair processSlashingsReset 5.5520 us/op 4.1840 us/op 1.33
mainnet_e81889 - altair processRandaoMixesReset 10.707 us/op 6.6010 us/op 1.62
mainnet_e81889 - altair processHistoricalRootsUpdate 1.0600 us/op 958.00 ns/op 1.11
mainnet_e81889 - altair processParticipationFlagUpdates 2.5080 us/op 2.3400 us/op 1.07
mainnet_e81889 - altair processSyncCommitteeUpdates 1.0650 us/op 1.6600 us/op 0.64
mainnet_e81889 - altair afterProcessEpoch 82.053 ms/op 127.71 ms/op 0.64
capella processEpoch - mainnet_e217614 1.6964 s/op 2.8245 s/op 0.60
mainnet_e217614 - capella beforeProcessEpoch 469.85 ms/op 636.64 ms/op 0.74
mainnet_e217614 - capella processJustificationAndFinalization 19.250 us/op 25.213 us/op 0.76
mainnet_e217614 - capella processInactivityUpdates 20.467 ms/op 24.060 ms/op 0.85
mainnet_e217614 - capella processRewardsAndPenalties 558.78 ms/op 665.11 ms/op 0.84
mainnet_e217614 - capella processRegistryUpdates 26.019 us/op 23.346 us/op 1.11
mainnet_e217614 - capella processSlashings 790.00 ns/op 664.00 ns/op 1.19
mainnet_e217614 - capella processEth1DataReset 631.00 ns/op 1.0470 us/op 0.60
mainnet_e217614 - capella processEffectiveBalanceUpdates 3.6540 ms/op 4.9622 ms/op 0.74
mainnet_e217614 - capella processSlashingsReset 3.2450 us/op 7.4350 us/op 0.44
mainnet_e217614 - capella processRandaoMixesReset 6.1350 us/op 6.6820 us/op 0.92
mainnet_e217614 - capella processHistoricalRootsUpdate 953.00 ns/op 614.00 ns/op 1.55
mainnet_e217614 - capella processParticipationFlagUpdates 2.0720 us/op 1.7520 us/op 1.18
mainnet_e217614 - capella afterProcessEpoch 213.54 ms/op 368.84 ms/op 0.58
phase0 processEpoch - mainnet_e58758 357.93 ms/op 509.68 ms/op 0.70
mainnet_e58758 - phase0 beforeProcessEpoch 114.39 ms/op 164.30 ms/op 0.70
mainnet_e58758 - phase0 processJustificationAndFinalization 12.399 us/op 23.981 us/op 0.52
mainnet_e58758 - phase0 processRewardsAndPenalties 57.902 ms/op 61.084 ms/op 0.95
mainnet_e58758 - phase0 processRegistryUpdates 15.100 us/op 19.490 us/op 0.77
mainnet_e58758 - phase0 processSlashings 1.1790 us/op 902.00 ns/op 1.31
mainnet_e58758 - phase0 processEth1DataReset 1.3260 us/op 772.00 ns/op 1.72
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 958.71 us/op 1.2279 ms/op 0.78
mainnet_e58758 - phase0 processSlashingsReset 5.5020 us/op 5.7260 us/op 0.96
mainnet_e58758 - phase0 processRandaoMixesReset 9.4160 us/op 6.2660 us/op 1.50
mainnet_e58758 - phase0 processHistoricalRootsUpdate 1.3250 us/op 479.00 ns/op 2.77
mainnet_e58758 - phase0 processParticipationRecordUpdates 5.9110 us/op 4.7440 us/op 1.25
mainnet_e58758 - phase0 afterProcessEpoch 71.639 ms/op 118.29 ms/op 0.61
phase0 processEffectiveBalanceUpdates - 250000 normalcase 1.0338 ms/op 1.5829 ms/op 0.65
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 1.7037 ms/op 1.6433 ms/op 1.04
altair processInactivityUpdates - 250000 normalcase 28.195 ms/op 29.956 ms/op 0.94
altair processInactivityUpdates - 250000 worstcase 31.081 ms/op 26.592 ms/op 1.17
phase0 processRegistryUpdates - 250000 normalcase 10.006 us/op 10.034 us/op 1.00
phase0 processRegistryUpdates - 250000 badcase_full_deposits 474.31 us/op 462.83 us/op 1.02
phase0 processRegistryUpdates - 250000 worstcase 0.5 134.19 ms/op 168.08 ms/op 0.80
altair processRewardsAndPenalties - 250000 normalcase 74.608 ms/op 69.717 ms/op 1.07
altair processRewardsAndPenalties - 250000 worstcase 77.834 ms/op 64.826 ms/op 1.20
phase0 getAttestationDeltas - 250000 normalcase 8.6771 ms/op 12.339 ms/op 0.70
phase0 getAttestationDeltas - 250000 worstcase 8.2947 ms/op 13.535 ms/op 0.61
phase0 processSlashings - 250000 worstcase 90.411 us/op 112.46 us/op 0.80
altair processSyncCommitteeUpdates - 250000 117.02 ms/op 182.12 ms/op 0.64
BeaconState.hashTreeRoot - No change 576.00 ns/op 282.00 ns/op 2.04
BeaconState.hashTreeRoot - 1 full validator 100.50 us/op 143.49 us/op 0.70
BeaconState.hashTreeRoot - 32 full validator 1.1958 ms/op 1.5903 ms/op 0.75
BeaconState.hashTreeRoot - 512 full validator 13.708 ms/op 21.045 ms/op 0.65
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 134.94 us/op 229.47 us/op 0.59
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 2.0190 ms/op 3.0160 ms/op 0.67
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 21.666 ms/op 39.009 ms/op 0.56
BeaconState.hashTreeRoot - 1 balances 95.283 us/op 174.55 us/op 0.55
BeaconState.hashTreeRoot - 32 balances 837.58 us/op 1.2927 ms/op 0.65
BeaconState.hashTreeRoot - 512 balances 10.425 ms/op 13.350 ms/op 0.78
BeaconState.hashTreeRoot - 250000 balances 170.22 ms/op 222.95 ms/op 0.76
aggregationBits - 2048 els - zipIndexesInBitList 20.709 us/op 53.452 us/op 0.39
byteArrayEquals 32 66.047 ns/op 94.758 ns/op 0.70
Buffer.compare 32 38.360 ns/op 67.674 ns/op 0.57
byteArrayEquals 1024 1.7906 us/op 2.4023 us/op 0.75
Buffer.compare 1024 47.376 ns/op 86.543 ns/op 0.55
byteArrayEquals 16384 29.018 us/op 44.870 us/op 0.65
Buffer.compare 16384 197.49 ns/op 353.61 ns/op 0.56
byteArrayEquals 123687377 208.49 ms/op 327.30 ms/op 0.64
Buffer.compare 123687377 6.8935 ms/op 13.746 ms/op 0.50
byteArrayEquals 32 - diff last byte 60.170 ns/op 111.74 ns/op 0.54
Buffer.compare 32 - diff last byte 37.082 ns/op 70.890 ns/op 0.52
byteArrayEquals 1024 - diff last byte 1.6770 us/op 2.9195 us/op 0.57
Buffer.compare 1024 - diff last byte 49.307 ns/op 93.693 ns/op 0.53
byteArrayEquals 16384 - diff last byte 26.691 us/op 49.712 us/op 0.54
Buffer.compare 16384 - diff last byte 228.40 ns/op 429.68 ns/op 0.53
byteArrayEquals 123687377 - diff last byte 212.88 ms/op 330.45 ms/op 0.64
Buffer.compare 123687377 - diff last byte 6.5932 ms/op 12.081 ms/op 0.55
byteArrayEquals 32 - random bytes 5.5070 ns/op 10.267 ns/op 0.54
Buffer.compare 32 - random bytes 41.833 ns/op 73.982 ns/op 0.57
byteArrayEquals 1024 - random bytes 5.5980 ns/op 7.5750 ns/op 0.74
Buffer.compare 1024 - random bytes 41.571 ns/op 70.097 ns/op 0.59
byteArrayEquals 16384 - random bytes 5.2570 ns/op 7.9320 ns/op 0.66
Buffer.compare 16384 - random bytes 38.943 ns/op 71.232 ns/op 0.55
byteArrayEquals 123687377 - random bytes 14.280 ns/op 20.920 ns/op 0.68
Buffer.compare 123687377 - random bytes 54.180 ns/op 88.210 ns/op 0.61
regular array get 100000 times 44.717 us/op 54.936 us/op 0.81
wrappedArray get 100000 times 43.254 us/op 57.468 us/op 0.75
arrayWithProxy get 100000 times 10.246 ms/op 21.973 ms/op 0.47
ssz.Root.equals 56.789 ns/op 88.856 ns/op 0.64
byteArrayEquals 56.732 ns/op 65.952 ns/op 0.86
Buffer.compare 13.458 ns/op 14.146 ns/op 0.95
shuffle list - 16384 els 5.8122 ms/op 10.044 ms/op 0.58
shuffle list - 250000 els 86.430 ms/op 157.09 ms/op 0.55
processSlot - 1 slots 16.058 us/op 25.239 us/op 0.64
processSlot - 32 slots 2.7959 ms/op 4.9789 ms/op 0.56
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 53.550 ms/op 80.299 ms/op 0.67
getCommitteeAssignments - req 1 vs - 250000 vc 2.4249 ms/op 3.2169 ms/op 0.75
getCommitteeAssignments - req 100 vs - 250000 vc 3.5867 ms/op 4.5701 ms/op 0.78
getCommitteeAssignments - req 1000 vs - 250000 vc 3.8726 ms/op 5.0196 ms/op 0.77
findModifiedValidators - 10000 modified validators 325.95 ms/op 547.42 ms/op 0.60
findModifiedValidators - 1000 modified validators 186.14 ms/op 328.85 ms/op 0.57
findModifiedValidators - 100 modified validators 159.96 ms/op 286.11 ms/op 0.56
findModifiedValidators - 10 modified validators 158.98 ms/op 304.41 ms/op 0.52
findModifiedValidators - 1 modified validators 167.98 ms/op 335.33 ms/op 0.50
findModifiedValidators - no difference 173.17 ms/op 351.17 ms/op 0.49
compare ViewDUs 4.4088 s/op 6.3913 s/op 0.69
compare each validator Uint8Array 1.7607 s/op 2.0033 s/op 0.88
compare ViewDU to Uint8Array 945.74 ms/op 1.8226 s/op 0.52
migrate state 1000000 validators, 24 modified, 0 new 658.50 ms/op 1.1061 s/op 0.60
migrate state 1000000 validators, 1700 modified, 1000 new 1.0538 s/op 1.4178 s/op 0.74
migrate state 1000000 validators, 3400 modified, 2000 new 1.0955 s/op 1.6705 s/op 0.66
migrate state 1500000 validators, 24 modified, 0 new 675.33 ms/op 1.1009 s/op 0.61
migrate state 1500000 validators, 1700 modified, 1000 new 948.09 ms/op 1.4537 s/op 0.65
migrate state 1500000 validators, 3400 modified, 2000 new 1.1816 s/op 1.7895 s/op 0.66
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 4.6300 ns/op 6.2200 ns/op 0.74
state getBlockRootAtSlot - 250000 vs - 7PWei 799.00 ns/op 843.25 ns/op 0.95
computeProposers - vc 250000 7.2879 ms/op 11.986 ms/op 0.61
computeEpochShuffling - vc 250000 88.341 ms/op 151.46 ms/op 0.58
getNextSyncCommittee - vc 250000 110.53 ms/op 205.89 ms/op 0.54
computeSigningRoot for AttestationData 24.489 us/op 38.357 us/op 0.64
hash AttestationData serialized data then Buffer.toString(base64) 1.2534 us/op 2.8453 us/op 0.44
toHexString serialized data 793.68 ns/op 1.8004 us/op 0.44
Buffer.toString(base64) 158.84 ns/op 323.37 ns/op 0.49

by benchmarkbot/action

@nazarhussain nazarhussain merged commit 3226411 into unstable Apr 5, 2024
22 checks passed
@nazarhussain nazarhussain deleted the nflaig/web3signer-deneb branch April 5, 2024 14:56
@wemeetagain
Copy link
Member

🎉 This PR is included in v1.18.0 🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@nazarhussain nazarhussain nazarhussain approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@nflaig @wemeetagain @nazarhussain