Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

refactor(test): use the configurable logger consistently via top level interface of crucible #6871

Merged
merged 4 commits into from
Jun 10, 2024
Merged

refactor(test): use the configurable logger consistently via top level interface of crucible #6871

merged 4 commits into from
Jun 10, 2024

Conversation

nazarhussain
Copy link
Contributor

@nazarhussain nazarhussain commented Jun 10, 2024 •
edited
Loading

Motivation

Use the configurable logging in the sim tests.

Description

  • Use the logger consistently across different components of the crucible
  • The log level should be configurable via the Simulation interface
  • Simplify the health interface

Steps to test or reproduce

  • Run all tests

@nazarhussain nazarhussain requested a review from a team as a code owner June 10, 2024 12:27
@nazarhussain nazarhussain self-assigned this Jun 10, 2024
@codecov Codecov
Copy link

codecov bot commented Jun 10, 2024 •
edited
Loading

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 62.19%. Comparing base (95ce044) to head (d776a88).
Report is 24 commits behind head on unstable.

Additional details and impacted files 
@@             Coverage Diff              @@
##           unstable    #6871      +/-   ##
============================================
- Coverage     62.21%   62.19%   -0.03%     
============================================
  Files           571      571              
  Lines         60017    60100      +83     
  Branches       1975     1974       -1     
============================================
+ Hits          37338    37377      +39     
- Misses        22636    22680      +44     
  Partials         43       43

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jun 10, 2024 •
edited
Loading

Performance Report

✔️ no performance regression detected

Full benchmark results
Benchmark suite Current: 6cef99c Previous: 14855ea Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 988.55 us/op 842.05 us/op 1.17
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 76.906 us/op 49.203 us/op 1.56
BLS verify - blst-native 1.5615 ms/op 1.2079 ms/op 1.29
BLS verifyMultipleSignatures 3 - blst-native 3.3212 ms/op 2.5709 ms/op 1.29
BLS verifyMultipleSignatures 8 - blst-native 7.2833 ms/op 5.6705 ms/op 1.28
BLS verifyMultipleSignatures 32 - blst-native 25.657 ms/op 20.917 ms/op 1.23
BLS verifyMultipleSignatures 64 - blst-native 50.243 ms/op 41.047 ms/op 1.22
BLS verifyMultipleSignatures 128 - blst-native 110.11 ms/op 81.417 ms/op 1.35
BLS deserializing 10000 signatures 1.2021 s/op 841.72 ms/op 1.43
BLS deserializing 100000 signatures 10.523 s/op 8.4261 s/op 1.25
BLS verifyMultipleSignatures - same message - 3 - blst-native 1.4462 ms/op 1.2146 ms/op 1.19
BLS verifyMultipleSignatures - same message - 8 - blst-native 1.6458 ms/op 1.3729 ms/op 1.20
BLS verifyMultipleSignatures - same message - 32 - blst-native 2.5768 ms/op 2.1451 ms/op 1.20
BLS verifyMultipleSignatures - same message - 64 - blst-native 3.9131 ms/op 3.5655 ms/op 1.10
BLS verifyMultipleSignatures - same message - 128 - blst-native 5.8781 ms/op 5.3018 ms/op 1.11
BLS aggregatePubkeys 32 - blst-native 27.810 us/op 24.034 us/op 1.16
BLS aggregatePubkeys 128 - blst-native 106.84 us/op 94.785 us/op 1.13
notSeenSlots=1 numMissedVotes=1 numBadVotes=10 66.946 ms/op 61.503 ms/op 1.09
notSeenSlots=1 numMissedVotes=0 numBadVotes=4 63.635 ms/op 46.955 ms/op 1.36
notSeenSlots=2 numMissedVotes=1 numBadVotes=10 47.012 ms/op 28.615 ms/op 1.64
getSlashingsAndExits - default max 125.10 us/op 74.700 us/op 1.67
getSlashingsAndExits - 2k 324.24 us/op 254.20 us/op 1.28
proposeBlockBody type=full, size=empty 6.6347 ms/op 4.9966 ms/op 1.33
isKnown best case - 1 super set check 326.00 ns/op 276.00 ns/op 1.18
isKnown normal case - 2 super set checks 346.00 ns/op 265.00 ns/op 1.31
isKnown worse case - 16 super set checks 303.00 ns/op 260.00 ns/op 1.17
InMemoryCheckpointStateCache - add get delete 6.5700 us/op 4.2220 us/op 1.56
validate api signedAggregateAndProof - struct 2.8426 ms/op 2.5720 ms/op 1.11
validate gossip signedAggregateAndProof - struct 2.8351 ms/op 2.5780 ms/op 1.10
validate gossip attestation - vc 640000 1.4472 ms/op 1.2431 ms/op 1.16
batch validate gossip attestation - vc 640000 - chunk 32 173.81 us/op 144.93 us/op 1.20
batch validate gossip attestation - vc 640000 - chunk 64 150.91 us/op 129.23 us/op 1.17
batch validate gossip attestation - vc 640000 - chunk 128 142.59 us/op 124.97 us/op 1.14
batch validate gossip attestation - vc 640000 - chunk 256 133.43 us/op 116.21 us/op 1.15
pickEth1Vote - no votes 1.2173 ms/op 1.0583 ms/op 1.15
pickEth1Vote - max votes 8.8837 ms/op 6.3184 ms/op 1.41
pickEth1Vote - Eth1Data hashTreeRoot value x2048 16.173 ms/op 11.337 ms/op 1.43
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 28.869 ms/op 14.968 ms/op 1.93
pickEth1Vote - Eth1Data fastSerialize value x2048 627.91 us/op 490.61 us/op 1.28
pickEth1Vote - Eth1Data fastSerialize tree x2048 6.5781 ms/op 6.7930 ms/op 0.97
bytes32 toHexString 620.00 ns/op 433.00 ns/op 1.43
bytes32 Buffer.toString(hex) 292.00 ns/op 245.00 ns/op 1.19
bytes32 Buffer.toString(hex) from Uint8Array 481.00 ns/op 355.00 ns/op 1.35
bytes32 Buffer.toString(hex) + 0x 273.00 ns/op 248.00 ns/op 1.10
Object access 1 prop 0.16700 ns/op 0.14700 ns/op 1.14
Map access 1 prop 0.15100 ns/op 0.13900 ns/op 1.09
Object get x1000 7.0850 ns/op 6.1760 ns/op 1.15
Map get x1000 7.5420 ns/op 6.6220 ns/op 1.14
Object set x1000 40.854 ns/op 33.838 ns/op 1.21
Map set x1000 29.561 ns/op 22.413 ns/op 1.32
Return object 10000 times 0.34720 ns/op 0.29050 ns/op 1.20
Throw Error 10000 times 4.0049 us/op 3.4325 us/op 1.17
fastMsgIdFn sha256 / 200 bytes 2.4950 us/op 2.1930 us/op 1.14
fastMsgIdFn h32 xxhash / 200 bytes 298.00 ns/op 231.00 ns/op 1.29
fastMsgIdFn h64 xxhash / 200 bytes 313.00 ns/op 271.00 ns/op 1.15
fastMsgIdFn sha256 / 1000 bytes 8.3490 us/op 7.4330 us/op 1.12
fastMsgIdFn h32 xxhash / 1000 bytes 510.00 ns/op 358.00 ns/op 1.42
fastMsgIdFn h64 xxhash / 1000 bytes 436.00 ns/op 342.00 ns/op 1.27
fastMsgIdFn sha256 / 10000 bytes 75.283 us/op 64.252 us/op 1.17
fastMsgIdFn h32 xxhash / 10000 bytes 2.2140 us/op 1.8140 us/op 1.22
fastMsgIdFn h64 xxhash / 10000 bytes 1.3290 us/op 1.1930 us/op 1.11
send data - 1000 256B messages 15.046 ms/op 11.535 ms/op 1.30
send data - 1000 512B messages 21.021 ms/op 16.518 ms/op 1.27
send data - 1000 1024B messages 34.327 ms/op 25.909 ms/op 1.32
send data - 1000 1200B messages 29.682 ms/op 18.455 ms/op 1.61
send data - 1000 2048B messages 37.995 ms/op 31.063 ms/op 1.22
send data - 1000 4096B messages 37.421 ms/op 30.323 ms/op 1.23
send data - 1000 16384B messages 87.193 ms/op 68.164 ms/op 1.28
send data - 1000 65536B messages 241.42 ms/op 200.62 ms/op 1.20
enrSubnets - fastDeserialize 64 bits 1.6090 us/op 1.1120 us/op 1.45
enrSubnets - ssz BitVector 64 bits 507.00 ns/op 360.00 ns/op 1.41
enrSubnets - fastDeserialize 4 bits 220.00 ns/op 149.00 ns/op 1.48
enrSubnets - ssz BitVector 4 bits 504.00 ns/op 364.00 ns/op 1.38
prioritizePeers score -10:0 att 32-0.1 sync 2-0 233.02 us/op 138.86 us/op 1.68
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 221.88 us/op 170.04 us/op 1.30
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 428.75 us/op 236.54 us/op 1.81
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 632.04 us/op 385.47 us/op 1.64
prioritizePeers score 0:0 att 64-1 sync 4-1 1.0740 ms/op 585.45 us/op 1.83
array of 16000 items push then shift 2.1817 us/op 1.6180 us/op 1.35
LinkedList of 16000 items push then shift 9.5320 ns/op 7.2190 ns/op 1.32
array of 16000 items push then pop 164.79 ns/op 107.70 ns/op 1.53
LinkedList of 16000 items push then pop 9.3220 ns/op 7.1720 ns/op 1.30
array of 24000 items push then shift 3.0495 us/op 2.4083 us/op 1.27
LinkedList of 24000 items push then shift 10.802 ns/op 7.3280 ns/op 1.47
array of 24000 items push then pop 216.02 ns/op 136.41 ns/op 1.58
LinkedList of 24000 items push then pop 9.3480 ns/op 7.2260 ns/op 1.29
intersect bitArray bitLen 8 7.2030 ns/op 6.4330 ns/op 1.12
intersect array and set length 8 64.635 ns/op 46.472 ns/op 1.39
intersect bitArray bitLen 128 36.093 ns/op 30.107 ns/op 1.20
intersect array and set length 128 952.37 ns/op 681.46 ns/op 1.40
bitArray.getTrueBitIndexes() bitLen 128 2.6190 us/op 1.6820 us/op 1.56
bitArray.getTrueBitIndexes() bitLen 248 4.6750 us/op 3.0670 us/op 1.52
bitArray.getTrueBitIndexes() bitLen 512 9.4300 us/op 6.1270 us/op 1.54
Buffer.concat 32 items 1.1470 us/op 943.00 ns/op 1.22
Uint8Array.set 32 items 1.7460 us/op 2.2540 us/op 0.77
Buffer.copy 2.0100 us/op 2.4630 us/op 0.82
Uint8Array.set - with subarray 3.0330 us/op 2.7140 us/op 1.12
Uint8Array.set - without subarray 1.6280 us/op 1.4970 us/op 1.09
Set add up to 64 items then delete first 2.7374 us/op 2.1437 us/op 1.28
OrderedSet add up to 64 items then delete first 4.1306 us/op 3.2881 us/op 1.26
Set add up to 64 items then delete last 2.8323 us/op 2.4138 us/op 1.17
OrderedSet add up to 64 items then delete last 4.2445 us/op 3.5351 us/op 1.20
Set add up to 64 items then delete middle 3.0753 us/op 2.4498 us/op 1.26
OrderedSet add up to 64 items then delete middle 6.6080 us/op 5.1130 us/op 1.29
Set add up to 128 items then delete first 6.5177 us/op 4.9645 us/op 1.31
OrderedSet add up to 128 items then delete first 11.176 us/op 7.7510 us/op 1.44
Set add up to 128 items then delete last 6.7162 us/op 4.7724 us/op 1.41
OrderedSet add up to 128 items then delete last 10.778 us/op 7.0127 us/op 1.54
Set add up to 128 items then delete middle 6.9946 us/op 4.7167 us/op 1.48
OrderedSet add up to 128 items then delete middle 17.921 us/op 13.335 us/op 1.34
Set add up to 256 items then delete first 14.051 us/op 10.034 us/op 1.40
OrderedSet add up to 256 items then delete first 19.631 us/op 15.631 us/op 1.26
Set add up to 256 items then delete last 11.926 us/op 9.5107 us/op 1.25
OrderedSet add up to 256 items then delete last 17.104 us/op 14.207 us/op 1.20
Set add up to 256 items then delete middle 10.985 us/op 9.4065 us/op 1.17
OrderedSet add up to 256 items then delete middle 46.010 us/op 40.149 us/op 1.15
transfer serialized Status (84 B) 1.4520 us/op 1.4640 us/op 0.99
copy serialized Status (84 B) 1.2310 us/op 1.1640 us/op 1.06
transfer serialized SignedVoluntaryExit (112 B) 1.6950 us/op 1.6410 us/op 1.03
copy serialized SignedVoluntaryExit (112 B) 1.5350 us/op 1.2030 us/op 1.28
transfer serialized ProposerSlashing (416 B) 2.3850 us/op 2.0550 us/op 1.16
copy serialized ProposerSlashing (416 B) 2.2240 us/op 1.5090 us/op 1.47
transfer serialized Attestation (485 B) 2.7310 us/op 1.6050 us/op 1.70
copy serialized Attestation (485 B) 2.1800 us/op 1.5750 us/op 1.38
transfer serialized AttesterSlashing (33232 B) 2.1760 us/op 2.0270 us/op 1.07
copy serialized AttesterSlashing (33232 B) 5.3220 us/op 4.8730 us/op 1.09
transfer serialized Small SignedBeaconBlock (128000 B) 3.2150 us/op 2.7450 us/op 1.17
copy serialized Small SignedBeaconBlock (128000 B) 16.274 us/op 14.011 us/op 1.16
transfer serialized Avg SignedBeaconBlock (200000 B) 3.9130 us/op 3.3640 us/op 1.16
copy serialized Avg SignedBeaconBlock (200000 B) 25.026 us/op 21.251 us/op 1.18
transfer serialized BlobsSidecar (524380 B) 3.8460 us/op 3.1320 us/op 1.23
copy serialized BlobsSidecar (524380 B) 81.295 us/op 88.126 us/op 0.92
transfer serialized Big SignedBeaconBlock (1000000 B) 3.3350 us/op 3.0010 us/op 1.11
copy serialized Big SignedBeaconBlock (1000000 B) 168.97 us/op 143.00 us/op 1.18
pass gossip attestations to forkchoice per slot 3.4783 ms/op 2.9812 ms/op 1.17
forkChoice updateHead vc 100000 bc 64 eq 0 753.03 us/op 487.16 us/op 1.55
forkChoice updateHead vc 600000 bc 64 eq 0 3.4076 ms/op 3.0584 ms/op 1.11
forkChoice updateHead vc 1000000 bc 64 eq 0 6.0251 ms/op 5.2555 ms/op 1.15
forkChoice updateHead vc 600000 bc 320 eq 0 4.0795 ms/op 3.5567 ms/op 1.15
forkChoice updateHead vc 600000 bc 1200 eq 0 4.3677 ms/op 3.0360 ms/op 1.44
forkChoice updateHead vc 600000 bc 7200 eq 0 5.7537 ms/op 3.4649 ms/op 1.66
forkChoice updateHead vc 600000 bc 64 eq 1000 12.876 ms/op 10.461 ms/op 1.23
forkChoice updateHead vc 600000 bc 64 eq 10000 13.413 ms/op 10.841 ms/op 1.24
forkChoice updateHead vc 600000 bc 64 eq 300000 23.190 ms/op 14.722 ms/op 1.58
computeDeltas 500000 validators 300 proto nodes 5.7417 ms/op 3.4851 ms/op 1.65
computeDeltas 500000 validators 1200 proto nodes 5.9054 ms/op 3.5093 ms/op 1.68
computeDeltas 500000 validators 7200 proto nodes 5.3635 ms/op 3.5005 ms/op 1.53
computeDeltas 750000 validators 300 proto nodes 8.9309 ms/op 5.1852 ms/op 1.72
computeDeltas 750000 validators 1200 proto nodes 10.276 ms/op 5.1219 ms/op 2.01
computeDeltas 750000 validators 7200 proto nodes 7.5310 ms/op 5.1559 ms/op 1.46
computeDeltas 1400000 validators 300 proto nodes 13.401 ms/op 9.5973 ms/op 1.40
computeDeltas 1400000 validators 1200 proto nodes 13.162 ms/op 9.8207 ms/op 1.34
computeDeltas 1400000 validators 7200 proto nodes 12.701 ms/op 9.7398 ms/op 1.30
computeDeltas 2100000 validators 300 proto nodes 19.680 ms/op 14.557 ms/op 1.35
computeDeltas 2100000 validators 1200 proto nodes 20.653 ms/op 14.673 ms/op 1.41
computeDeltas 2100000 validators 7200 proto nodes 21.620 ms/op 14.723 ms/op 1.47
altair processAttestation - 250000 vs - 7PWei normalcase 2.7401 ms/op 1.7706 ms/op 1.55
altair processAttestation - 250000 vs - 7PWei worstcase 2.7271 ms/op 2.4851 ms/op 1.10
altair processAttestation - setStatus - 1/6 committees join 99.586 us/op 93.452 us/op 1.07
altair processAttestation - setStatus - 1/3 committees join 190.33 us/op 176.08 us/op 1.08
altair processAttestation - setStatus - 1/2 committees join 278.12 us/op 254.38 us/op 1.09
altair processAttestation - setStatus - 2/3 committees join 348.81 us/op 327.96 us/op 1.06
altair processAttestation - setStatus - 4/5 committees join 562.82 us/op 526.38 us/op 1.07
altair processAttestation - setStatus - 100% committees join 638.61 us/op 589.53 us/op 1.08
altair processBlock - 250000 vs - 7PWei normalcase 5.2580 ms/op 5.2086 ms/op 1.01
altair processBlock - 250000 vs - 7PWei normalcase hashState 33.568 ms/op 26.457 ms/op 1.27
altair processBlock - 250000 vs - 7PWei worstcase 54.535 ms/op 46.450 ms/op 1.17
altair processBlock - 250000 vs - 7PWei worstcase hashState 111.31 ms/op 90.511 ms/op 1.23
phase0 processBlock - 250000 vs - 7PWei normalcase 2.7900 ms/op 2.3637 ms/op 1.18
phase0 processBlock - 250000 vs - 7PWei worstcase 34.388 ms/op 30.508 ms/op 1.13
altair processEth1Data - 250000 vs - 7PWei normalcase 579.71 us/op 418.59 us/op 1.38
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15 8.1630 us/op 8.3980 us/op 0.97
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219 29.559 us/op 35.366 us/op 0.84
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42 11.008 us/op 13.356 us/op 0.82
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18 8.2450 us/op 9.6500 us/op 0.85
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020 112.62 us/op 141.66 us/op 0.80
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777 855.38 us/op 762.32 us/op 1.12
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384 1.3219 ms/op 1.0140 ms/op 1.30
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384 1.2752 ms/op 949.03 us/op 1.34
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384 3.6241 ms/op 2.5009 ms/op 1.45
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384 2.0297 ms/op 1.8269 ms/op 1.11
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384 4.9084 ms/op 4.3170 ms/op 1.14
Tree 40 250000 create 552.63 ms/op 279.38 ms/op 1.98
Tree 40 250000 get(125000) 188.58 ns/op 162.63 ns/op 1.16
Tree 40 250000 set(125000) 1.4247 us/op 924.03 ns/op 1.54
Tree 40 250000 toArray() 24.359 ms/op 22.598 ms/op 1.08
Tree 40 250000 iterate all - toArray() + loop 23.974 ms/op 22.773 ms/op 1.05
Tree 40 250000 iterate all - get(i) 73.438 ms/op 61.348 ms/op 1.20
MutableVector 250000 create 17.152 ms/op 9.2495 ms/op 1.85
MutableVector 250000 get(125000) 8.6260 ns/op 6.5090 ns/op 1.33
MutableVector 250000 set(125000) 395.00 ns/op 278.30 ns/op 1.42
MutableVector 250000 toArray() 6.2123 ms/op 5.0603 ms/op 1.23
MutableVector 250000 iterate all - toArray() + loop 7.0654 ms/op 5.2390 ms/op 1.35
MutableVector 250000 iterate all - get(i) 2.7578 ms/op 1.7054 ms/op 1.62
Array 250000 create 5.1842 ms/op 4.5569 ms/op 1.14
Array 250000 clone - spread 4.9547 ms/op 2.0674 ms/op 2.40
Array 250000 get(125000) 0.53300 ns/op 0.45300 ns/op 1.18
Array 250000 set(125000) 0.54600 ns/op 0.47900 ns/op 1.14
Array 250000 iterate all - loop 111.60 us/op 92.013 us/op 1.21
effectiveBalanceIncrements clone Uint8Array 300000 64.906 us/op 61.230 us/op 1.06
effectiveBalanceIncrements clone MutableVector 300000 144.00 ns/op 129.00 ns/op 1.12
effectiveBalanceIncrements rw all Uint8Array 300000 275.83 us/op 210.89 us/op 1.31
effectiveBalanceIncrements rw all MutableVector 300000 162.40 ms/op 105.54 ms/op 1.54
phase0 afterProcessEpoch - 250000 vs - 7PWei 130.55 ms/op 92.492 ms/op 1.41
phase0 beforeProcessEpoch - 250000 vs - 7PWei 61.536 ms/op 46.613 ms/op 1.32
altair processEpoch - mainnet_e81889 492.43 ms/op 392.78 ms/op 1.25
mainnet_e81889 - altair beforeProcessEpoch 88.371 ms/op 61.640 ms/op 1.43
mainnet_e81889 - altair processJustificationAndFinalization 27.776 us/op 21.905 us/op 1.27
mainnet_e81889 - altair processInactivityUpdates 8.2551 ms/op 7.5334 ms/op 1.10
mainnet_e81889 - altair processRewardsAndPenalties 52.063 ms/op 45.497 ms/op 1.14
mainnet_e81889 - altair processRegistryUpdates 2.1980 us/op 2.5480 us/op 0.86
mainnet_e81889 - altair processSlashings 977.00 ns/op 530.00 ns/op 1.84
mainnet_e81889 - altair processEth1DataReset 1.1130 us/op 608.00 ns/op 1.83
mainnet_e81889 - altair processEffectiveBalanceUpdates 1.7319 ms/op 1.1493 ms/op 1.51
mainnet_e81889 - altair processSlashingsReset 5.3060 us/op 3.1740 us/op 1.67
mainnet_e81889 - altair processRandaoMixesReset 7.9580 us/op 5.5650 us/op 1.43
mainnet_e81889 - altair processHistoricalRootsUpdate 1.9210 us/op 783.00 ns/op 2.45
mainnet_e81889 - altair processParticipationFlagUpdates 4.4810 us/op 3.1410 us/op 1.43
mainnet_e81889 - altair processSyncCommitteeUpdates 1.3910 us/op 549.00 ns/op 2.53
mainnet_e81889 - altair afterProcessEpoch 114.38 ms/op 92.816 ms/op 1.23
capella processEpoch - mainnet_e217614 1.5159 s/op 1.2345 s/op 1.23
mainnet_e217614 - capella beforeProcessEpoch 292.85 ms/op 236.79 ms/op 1.24
mainnet_e217614 - capella processJustificationAndFinalization 20.447 us/op 11.829 us/op 1.73
mainnet_e217614 - capella processInactivityUpdates 18.185 ms/op 15.970 ms/op 1.14
mainnet_e217614 - capella processRewardsAndPenalties 276.51 ms/op 227.46 ms/op 1.22
mainnet_e217614 - capella processRegistryUpdates 18.160 us/op 12.385 us/op 1.47
mainnet_e217614 - capella processSlashings 1.1830 us/op 369.00 ns/op 3.21
mainnet_e217614 - capella processEth1DataReset 509.00 ns/op 300.00 ns/op 1.70
mainnet_e217614 - capella processEffectiveBalanceUpdates 6.9782 ms/op 10.264 ms/op 0.68
mainnet_e217614 - capella processSlashingsReset 5.7540 us/op 4.0940 us/op 1.41
mainnet_e217614 - capella processRandaoMixesReset 10.206 us/op 4.3870 us/op 2.33
mainnet_e217614 - capella processHistoricalRootsUpdate 682.00 ns/op 545.00 ns/op 1.25
mainnet_e217614 - capella processParticipationFlagUpdates 2.2390 us/op 2.0690 us/op 1.08
mainnet_e217614 - capella afterProcessEpoch 321.49 ms/op 273.22 ms/op 1.18
phase0 processEpoch - mainnet_e58758 403.07 ms/op 354.60 ms/op 1.14
mainnet_e58758 - phase0 beforeProcessEpoch 125.11 ms/op 110.45 ms/op 1.13
mainnet_e58758 - phase0 processJustificationAndFinalization 25.747 us/op 13.981 us/op 1.84
mainnet_e58758 - phase0 processRewardsAndPenalties 31.498 ms/op 34.802 ms/op 0.91
mainnet_e58758 - phase0 processRegistryUpdates 11.603 us/op 7.3380 us/op 1.58
mainnet_e58758 - phase0 processSlashings 603.00 ns/op 383.00 ns/op 1.57
mainnet_e58758 - phase0 processEth1DataReset 340.00 ns/op 329.00 ns/op 1.03
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 1.3365 ms/op 956.28 us/op 1.40
mainnet_e58758 - phase0 processSlashingsReset 5.8880 us/op 2.3900 us/op 2.46
mainnet_e58758 - phase0 processRandaoMixesReset 7.3820 us/op 3.6900 us/op 2.00
mainnet_e58758 - phase0 processHistoricalRootsUpdate 651.00 ns/op 318.00 ns/op 2.05
mainnet_e58758 - phase0 processParticipationRecordUpdates 6.2520 us/op 2.5460 us/op 2.46
mainnet_e58758 - phase0 afterProcessEpoch 93.409 ms/op 74.238 ms/op 1.26
phase0 processEffectiveBalanceUpdates - 250000 normalcase 1.7372 ms/op 1.4607 ms/op 1.19
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 3.8445 ms/op 2.0003 ms/op 1.92
altair processInactivityUpdates - 250000 normalcase 23.379 ms/op 15.835 ms/op 1.48
altair processInactivityUpdates - 250000 worstcase 21.155 ms/op 16.143 ms/op 1.31
phase0 processRegistryUpdates - 250000 normalcase 9.3250 us/op 6.3070 us/op 1.48
phase0 processRegistryUpdates - 250000 badcase_full_deposits 371.02 us/op 231.80 us/op 1.60
phase0 processRegistryUpdates - 250000 worstcase 0.5 152.81 ms/op 116.32 ms/op 1.31
altair processRewardsAndPenalties - 250000 normalcase 52.469 ms/op 37.578 ms/op 1.40
altair processRewardsAndPenalties - 250000 worstcase 43.896 ms/op 41.204 ms/op 1.07
phase0 getAttestationDeltas - 250000 normalcase 8.2199 ms/op 6.7671 ms/op 1.21
phase0 getAttestationDeltas - 250000 worstcase 10.037 ms/op 6.9649 ms/op 1.44
phase0 processSlashings - 250000 worstcase 91.874 us/op 73.997 us/op 1.24
altair processSyncCommitteeUpdates - 250000 150.98 ms/op 125.84 ms/op 1.20
BeaconState.hashTreeRoot - No change 426.00 ns/op 255.00 ns/op 1.67
BeaconState.hashTreeRoot - 1 full validator 141.14 us/op 126.88 us/op 1.11
BeaconState.hashTreeRoot - 32 full validator 1.1767 ms/op 1.2624 ms/op 0.93
BeaconState.hashTreeRoot - 512 full validator 17.862 ms/op 10.467 ms/op 1.71
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 171.97 us/op 135.96 us/op 1.26
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 2.2875 ms/op 1.8717 ms/op 1.22
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 25.925 ms/op 23.458 ms/op 1.11
BeaconState.hashTreeRoot - 1 balances 112.47 us/op 106.47 us/op 1.06
BeaconState.hashTreeRoot - 32 balances 1.3638 ms/op 1.1359 ms/op 1.20
BeaconState.hashTreeRoot - 512 balances 14.100 ms/op 7.7953 ms/op 1.81
BeaconState.hashTreeRoot - 250000 balances 181.19 ms/op 176.76 ms/op 1.03
aggregationBits - 2048 els - zipIndexesInBitList 38.259 us/op 23.203 us/op 1.65
byteArrayEquals 32 60.811 ns/op 53.282 ns/op 1.14
Buffer.compare 32 50.690 ns/op 45.654 ns/op 1.11
byteArrayEquals 1024 1.8265 us/op 1.5768 us/op 1.16
Buffer.compare 1024 59.176 ns/op 54.460 ns/op 1.09
byteArrayEquals 16384 29.589 us/op 25.061 us/op 1.18
Buffer.compare 16384 255.51 ns/op 223.47 ns/op 1.14
byteArrayEquals 123687377 227.78 ms/op 189.06 ms/op 1.20
Buffer.compare 123687377 9.0742 ms/op 6.0588 ms/op 1.50
byteArrayEquals 32 - diff last byte 64.575 ns/op 52.127 ns/op 1.24
Buffer.compare 32 - diff last byte 57.599 ns/op 46.241 ns/op 1.25
byteArrayEquals 1024 - diff last byte 1.9228 us/op 1.5704 us/op 1.22
Buffer.compare 1024 - diff last byte 68.935 ns/op 53.448 ns/op 1.29
byteArrayEquals 16384 - diff last byte 30.824 us/op 25.051 us/op 1.23
Buffer.compare 16384 - diff last byte 288.75 ns/op 241.30 ns/op 1.20
byteArrayEquals 123687377 - diff last byte 219.66 ms/op 189.00 ms/op 1.16
Buffer.compare 123687377 - diff last byte 8.0296 ms/op 6.2463 ms/op 1.29
byteArrayEquals 32 - random bytes 6.0640 ns/op 5.1380 ns/op 1.18
Buffer.compare 32 - random bytes 56.086 ns/op 47.990 ns/op 1.17
byteArrayEquals 1024 - random bytes 5.8580 ns/op 5.0880 ns/op 1.15
Buffer.compare 1024 - random bytes 50.751 ns/op 45.994 ns/op 1.10
byteArrayEquals 16384 - random bytes 5.8470 ns/op 5.1110 ns/op 1.14
Buffer.compare 16384 - random bytes 51.301 ns/op 46.084 ns/op 1.11
byteArrayEquals 123687377 - random bytes 6.9100 ns/op 6.3300 ns/op 1.09
Buffer.compare 123687377 - random bytes 54.930 ns/op 47.340 ns/op 1.16
regular array get 100000 times 35.707 us/op 35.354 us/op 1.01
wrappedArray get 100000 times 37.356 us/op 32.711 us/op 1.14
arrayWithProxy get 100000 times 14.252 ms/op 12.692 ms/op 1.12
ssz.Root.equals 50.005 ns/op 45.640 ns/op 1.10
byteArrayEquals 48.682 ns/op 44.980 ns/op 1.08
Buffer.compare 11.350 ns/op 10.348 ns/op 1.10
shuffle list - 16384 els 7.0628 ms/op 6.1637 ms/op 1.15
shuffle list - 250000 els 100.72 ms/op 89.758 ms/op 1.12
processSlot - 1 slots 15.774 us/op 13.595 us/op 1.16
processSlot - 32 slots 3.1565 ms/op 2.7954 ms/op 1.13
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 41.309 ms/op 37.215 ms/op 1.11
getCommitteeAssignments - req 1 vs - 250000 vc 2.6416 ms/op 2.1280 ms/op 1.24
getCommitteeAssignments - req 100 vs - 250000 vc 5.0456 ms/op 4.1202 ms/op 1.22
getCommitteeAssignments - req 1000 vs - 250000 vc 4.7058 ms/op 4.3665 ms/op 1.08
findModifiedValidators - 10000 modified validators 279.19 ms/op 254.87 ms/op 1.10
findModifiedValidators - 1000 modified validators 188.07 ms/op 173.24 ms/op 1.09
findModifiedValidators - 100 modified validators 177.46 ms/op 152.58 ms/op 1.16
findModifiedValidators - 10 modified validators 173.88 ms/op 147.90 ms/op 1.18
findModifiedValidators - 1 modified validators 197.05 ms/op 156.53 ms/op 1.26
findModifiedValidators - no difference 175.51 ms/op 144.44 ms/op 1.22
compare ViewDUs 3.6420 s/op 2.9063 s/op 1.25
compare each validator Uint8Array 1.7153 s/op 1.5876 s/op 1.08
compare ViewDU to Uint8Array 1.4504 s/op 1.0114 s/op 1.43
migrate state 1000000 validators, 24 modified, 0 new 650.00 ms/op 596.63 ms/op 1.09
migrate state 1000000 validators, 1700 modified, 1000 new 946.88 ms/op 798.65 ms/op 1.19
migrate state 1000000 validators, 3400 modified, 2000 new 1.1341 s/op 1.0478 s/op 1.08
migrate state 1500000 validators, 24 modified, 0 new 580.06 ms/op 626.04 ms/op 0.93
migrate state 1500000 validators, 1700 modified, 1000 new 867.51 ms/op 861.33 ms/op 1.01
migrate state 1500000 validators, 3400 modified, 2000 new 1.0792 s/op 1.0388 s/op 1.04
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 5.4000 ns/op 4.3000 ns/op 1.26
state getBlockRootAtSlot - 250000 vs - 7PWei 594.54 ns/op 496.24 ns/op 1.20
computeProposers - vc 250000 7.8055 ms/op 8.4079 ms/op 0.93
computeEpochShuffling - vc 250000 97.475 ms/op 97.198 ms/op 1.00
getNextSyncCommittee - vc 250000 124.97 ms/op 141.07 ms/op 0.89
computeSigningRoot for AttestationData 27.532 us/op 23.717 us/op 1.16
hash AttestationData serialized data then Buffer.toString(base64) 1.6597 us/op 1.5014 us/op 1.11
toHexString serialized data 1.0368 us/op 898.40 ns/op 1.15
Buffer.toString(base64) 227.26 ns/op 195.60 ns/op 1.16

by benchmarkbot/action

@wemeetagain wemeetagain merged commit ff253a7 into unstable Jun 10, 2024
20 checks passed
@wemeetagain wemeetagain deleted the nh/sim-tests-update branch June 10, 2024 14:27
@wemeetagain
Copy link
Member

🎉 This PR is included in v1.20.0 🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@wemeetagain wemeetagain wemeetagain approved these changes

Assignees

@nazarhussain nazarhussain

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@nazarhussain @wemeetagain