Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Config update for mainnet-shadow-fork1 merge devnet #3892

Merged
merged 1 commit into from
Apr 7, 2022

Conversation

g11tech
Copy link
Contributor

@g11tech g11tech commented Apr 6, 2022

Motivation
Shadow fork 1 for mainnet!

Adds ability to follow shadow fork mainnet using lodestar <> geth | nethermind.

ethereumjs *should( work but is not yet performant for mainnet blocks, so might not sync up.
Description

Commands

  • nethermind: ./setup.sh --dataDir mainnet-shadow1 --elClient nethermind --devnetVars ./mainnetshadow-1.vars --dockerWithSudo --withTerminal "gnome-terminal --disable-factory --"
  • geth: ./setup.sh --dataDir mainnet-shadow1 --elClient geth --devnetVars ./mainnetshadow-1.vars --dockerWithSudo --withTerminal "gnome-terminal --disable-factory --"

@codecov
Copy link

codecov bot commented Apr 6, 2022

Codecov Report

Merging #3892 (a86f42c) into master (60fc678) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #3892   +/-   ##
=======================================
  Coverage   36.60%   36.60%           
=======================================
  Files         325      325           
  Lines        8975     8975           
  Branches     1407     1407           
=======================================
  Hits         3285     3285           
  Misses       5547     5547           
  Partials      143      143           

@github-actions
Copy link
Contributor

github-actions bot commented Apr 6, 2022

Performance Report

✔️ no performance regression detected

🚀🚀 Significant benchmark improvement detected

Benchmark suite Current: 2110466 Previous: 5bb4954 Ratio
altair processParticipationFlagUpdates - 250000 anycase 2.1450 us/op 13.871 us/op 0.15
Full benchmark results
Benchmark suite Current: 2110466 Previous: 5bb4954 Ratio
BeaconState.hashTreeRoot - No change 434.00 ns/op 542.00 ns/op 0.80
BeaconState.hashTreeRoot - 1 full validator 56.016 us/op 69.264 us/op 0.81
BeaconState.hashTreeRoot - 32 full validator 540.46 us/op 674.64 us/op 0.80
BeaconState.hashTreeRoot - 512 full validator 6.2104 ms/op 7.3063 ms/op 0.85
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 68.773 us/op 91.602 us/op 0.75
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 954.70 us/op 1.1963 ms/op 0.80
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 12.431 ms/op 16.077 ms/op 0.77
BeaconState.hashTreeRoot - 1 balances 51.664 us/op 64.599 us/op 0.80
BeaconState.hashTreeRoot - 32 balances 465.07 us/op 572.68 us/op 0.81
BeaconState.hashTreeRoot - 512 balances 4.6601 ms/op 5.4892 ms/op 0.85
BeaconState.hashTreeRoot - 250000 balances 95.641 ms/op 126.74 ms/op 0.75
processSlot - 1 slots 9.5760 us/op 13.130 us/op 0.73
processSlot - 32 slots 1.5552 ms/op 2.0236 ms/op 0.77
getCommitteeAssignments - req 1 vs - 250000 vc 4.6213 ms/op 5.1167 ms/op 0.90
getCommitteeAssignments - req 100 vs - 250000 vc 6.4631 ms/op 7.4948 ms/op 0.86
getCommitteeAssignments - req 1000 vs - 250000 vc 6.8741 ms/op 7.7742 ms/op 0.88
computeProposers - vc 250000 15.223 ms/op 19.319 ms/op 0.79
computeEpochShuffling - vc 250000 141.49 ms/op 150.43 ms/op 0.94
getNextSyncCommittee - vc 250000 251.13 ms/op 321.25 ms/op 0.78
altair processAttestation - 250000 vs - 7PWei normalcase 3.8220 ms/op 4.6912 ms/op 0.81
altair processAttestation - 250000 vs - 7PWei worstcase 5.6596 ms/op 6.9945 ms/op 0.81
altair processAttestation - setStatus - 1/6 committees join 176.54 us/op 215.68 us/op 0.82
altair processAttestation - setStatus - 1/3 committees join 376.05 us/op 415.50 us/op 0.91
altair processAttestation - setStatus - 1/2 committees join 520.50 us/op 584.20 us/op 0.89
altair processAttestation - setStatus - 2/3 committees join 676.89 us/op 753.03 us/op 0.90
altair processAttestation - setStatus - 4/5 committees join 938.32 us/op 1.0495 ms/op 0.89
altair processAttestation - setStatus - 100% committees join 991.08 us/op 1.3057 ms/op 0.76
altair processBlock - 250000 vs - 7PWei normalcase 19.803 ms/op 32.177 ms/op 0.62
altair processBlock - 250000 vs - 7PWei normalcase hashState 34.061 ms/op 41.336 ms/op 0.82
altair processBlock - 250000 vs - 7PWei worstcase 74.018 ms/op 84.893 ms/op 0.87
altair processBlock - 250000 vs - 7PWei worstcase hashState 91.681 ms/op 125.04 ms/op 0.73
altair processEth1Data - 250000 vs - 7PWei normalcase 907.11 us/op 1.0642 ms/op 0.85
altair processEpoch - mainnet_e81889 463.70 ms/op 594.72 ms/op 0.78
mainnet_e81889 - altair beforeProcessEpoch 138.74 ms/op 175.50 ms/op 0.79
mainnet_e81889 - altair processJustificationAndFinalization 24.354 us/op 73.471 us/op 0.33
mainnet_e81889 - altair processInactivityUpdates 10.781 ms/op 11.939 ms/op 0.90
mainnet_e81889 - altair processRewardsAndPenalties 124.48 ms/op 150.51 ms/op 0.83
mainnet_e81889 - altair processRegistryUpdates 6.2200 us/op 15.167 us/op 0.41
mainnet_e81889 - altair processSlashings 2.4800 us/op 6.4260 us/op 0.39
mainnet_e81889 - altair processEth1DataReset 1.6590 us/op 6.5970 us/op 0.25
mainnet_e81889 - altair processEffectiveBalanceUpdates 6.2462 ms/op 7.5458 ms/op 0.83
mainnet_e81889 - altair processSlashingsReset 4.4140 us/op 21.350 us/op 0.21
mainnet_e81889 - altair processRandaoMixesReset 6.1460 us/op 26.794 us/op 0.23
mainnet_e81889 - altair processHistoricalRootsUpdate 2.4450 us/op 9.0980 us/op 0.27
mainnet_e81889 - altair processParticipationFlagUpdates 5.8650 us/op 16.670 us/op 0.35
mainnet_e81889 - altair processSyncCommitteeUpdates 775.00 ns/op 5.4390 us/op 0.14
mainnet_e81889 - altair afterProcessEpoch 175.55 ms/op 177.67 ms/op 0.99
altair processInactivityUpdates - 250000 normalcase 36.183 ms/op 43.209 ms/op 0.84
altair processInactivityUpdates - 250000 worstcase 27.429 ms/op 37.693 ms/op 0.73
altair processParticipationFlagUpdates - 250000 anycase 2.1450 us/op 13.871 us/op 0.15
altair processRewardsAndPenalties - 250000 normalcase 111.43 ms/op 134.33 ms/op 0.83
altair processRewardsAndPenalties - 250000 worstcase 76.000 ms/op 87.112 ms/op 0.87
altair processSyncCommitteeUpdates - 250000 271.55 ms/op 348.77 ms/op 0.78
Tree 40 250000 create 736.45 ms/op 1.0005 s/op 0.74
Tree 40 250000 get(125000) 286.75 ns/op 313.25 ns/op 0.92
Tree 40 250000 set(125000) 2.4715 us/op 3.0724 us/op 0.80
Tree 40 250000 toArray() 32.184 ms/op 39.645 ms/op 0.81
Tree 40 250000 iterate all - toArray() + loop 32.141 ms/op 40.494 ms/op 0.79
Tree 40 250000 iterate all - get(i) 110.59 ms/op 132.44 ms/op 0.84
MutableVector 250000 create 16.876 ms/op 16.231 ms/op 1.04
MutableVector 250000 get(125000) 12.076 ns/op 13.417 ns/op 0.90
MutableVector 250000 set(125000) 642.43 ns/op 852.30 ns/op 0.75
MutableVector 250000 toArray() 6.6467 ms/op 7.0685 ms/op 0.94
MutableVector 250000 iterate all - toArray() + loop 6.9982 ms/op 7.0655 ms/op 0.99
MutableVector 250000 iterate all - get(i) 3.4418 ms/op 3.3276 ms/op 1.03
Array 250000 create 6.1876 ms/op 6.7201 ms/op 0.92
Array 250000 clone - spread 3.1941 ms/op 2.4476 ms/op 1.31
Array 250000 get(125000) 1.3360 ns/op 1.1770 ns/op 1.14
Array 250000 set(125000) 1.3670 ns/op 1.1840 ns/op 1.15
Array 250000 iterate all - loop 149.16 us/op 137.59 us/op 1.08
effectiveBalanceIncrements clone Uint8Array 300000 89.442 us/op 375.68 us/op 0.24
effectiveBalanceIncrements clone MutableVector 300000 901.00 ns/op 569.00 ns/op 1.58
effectiveBalanceIncrements rw all Uint8Array 300000 266.31 us/op 188.31 us/op 1.41
effectiveBalanceIncrements rw all MutableVector 300000 202.64 ms/op 223.41 ms/op 0.91
aggregationBits - 2048 els - zipIndexesInBitList 32.001 us/op 30.077 us/op 1.06
regular array get 100000 times 59.503 us/op 56.977 us/op 1.04
wrappedArray get 100000 times 59.562 us/op 54.510 us/op 1.09
arrayWithProxy get 100000 times 32.693 ms/op 38.991 ms/op 0.84
ssz.Root.equals 439.00 ns/op 522.00 ns/op 0.84
byteArrayEquals 437.00 ns/op 514.00 ns/op 0.85
phase0 processBlock - 250000 vs - 7PWei normalcase 3.2311 ms/op 4.2565 ms/op 0.76
phase0 processBlock - 250000 vs - 7PWei worstcase 41.201 ms/op 53.061 ms/op 0.78
phase0 afterProcessEpoch - 250000 vs - 7PWei 163.75 ms/op 172.17 ms/op 0.95
phase0 beforeProcessEpoch - 250000 vs - 7PWei 70.810 ms/op 84.529 ms/op 0.84
phase0 processEpoch - mainnet_e58758 482.53 ms/op 632.17 ms/op 0.76
mainnet_e58758 - phase0 beforeProcessEpoch 191.38 ms/op 273.42 ms/op 0.70
mainnet_e58758 - phase0 processJustificationAndFinalization 30.534 us/op 75.935 us/op 0.40
mainnet_e58758 - phase0 processRewardsAndPenalties 71.460 ms/op 94.309 ms/op 0.76
mainnet_e58758 - phase0 processRegistryUpdates 12.809 us/op 37.304 us/op 0.34
mainnet_e58758 - phase0 processSlashings 1.8230 us/op 7.4760 us/op 0.24
mainnet_e58758 - phase0 processEth1DataReset 1.8420 us/op 6.3570 us/op 0.29
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 5.3955 ms/op 6.7652 ms/op 0.80
mainnet_e58758 - phase0 processSlashingsReset 7.3860 us/op 22.243 us/op 0.33
mainnet_e58758 - phase0 processRandaoMixesReset 8.7810 us/op 29.050 us/op 0.30
mainnet_e58758 - phase0 processHistoricalRootsUpdate 2.2760 us/op 7.9990 us/op 0.28
mainnet_e58758 - phase0 processParticipationRecordUpdates 8.5160 us/op 26.291 us/op 0.32
mainnet_e58758 - phase0 afterProcessEpoch 151.90 ms/op 168.34 ms/op 0.90
phase0 processEffectiveBalanceUpdates - 250000 normalcase 5.5982 ms/op 7.2833 ms/op 0.77
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 6.0164 ms/op 7.4270 ms/op 0.81
phase0 processRegistryUpdates - 250000 normalcase 11.928 us/op 29.348 us/op 0.41
phase0 processRegistryUpdates - 250000 badcase_full_deposits 431.88 us/op 515.59 us/op 0.84
phase0 processRegistryUpdates - 250000 worstcase 0.5 232.04 ms/op 267.61 ms/op 0.87
phase0 getAttestationDeltas - 250000 normalcase 14.948 ms/op 17.694 ms/op 0.84
phase0 getAttestationDeltas - 250000 worstcase 15.924 ms/op 17.924 ms/op 0.89
phase0 processSlashings - 250000 worstcase 5.7165 ms/op 6.6116 ms/op 0.86
shuffle list - 16384 els 9.4306 ms/op 11.905 ms/op 0.79
shuffle list - 250000 els 136.37 ms/op 153.41 ms/op 0.89
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 387.69 us/op 470.12 us/op 0.82
pass gossip attestations to forkchoice per slot 3.3998 ms/op 4.1821 ms/op 0.81
computeDeltas 3.2108 ms/op 3.6718 ms/op 0.87
computeProposerBoostScoreFromBalances 444.04 us/op 448.01 us/op 0.99
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 2.4924 ms/op 3.0120 ms/op 0.83
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 76.926 us/op 91.005 us/op 0.85
BLS verify - blst-native 1.8573 ms/op 2.1260 ms/op 0.87
BLS verifyMultipleSignatures 3 - blst-native 3.8025 ms/op 4.3192 ms/op 0.88
BLS verifyMultipleSignatures 8 - blst-native 8.1889 ms/op 9.2065 ms/op 0.89
BLS verifyMultipleSignatures 32 - blst-native 29.697 ms/op 33.920 ms/op 0.88
BLS aggregatePubkeys 32 - blst-native 39.492 us/op 44.723 us/op 0.88
BLS aggregatePubkeys 128 - blst-native 154.02 us/op 176.30 us/op 0.87
getAttestationsForBlock 52.828 ms/op 61.213 ms/op 0.86
CheckpointStateCache - add get delete 10.573 us/op 13.894 us/op 0.76
validate gossip signedAggregateAndProof - struct 4.2653 ms/op 4.9693 ms/op 0.86
validate gossip attestation - struct 2.0291 ms/op 2.4948 ms/op 0.81
pickEth1Vote - no votes 2.2207 ms/op 2.5885 ms/op 0.86
pickEth1Vote - max votes 20.103 ms/op 25.039 ms/op 0.80
pickEth1Vote - Eth1Data hashTreeRoot value x2048 12.126 ms/op 15.708 ms/op 0.77
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 20.627 ms/op 26.136 ms/op 0.79
pickEth1Vote - Eth1Data fastSerialize value x2048 1.5800 ms/op 1.9404 ms/op 0.81
pickEth1Vote - Eth1Data fastSerialize tree x2048 14.285 ms/op 17.616 ms/op 0.81
bytes32 toHexString 1.0120 us/op 1.3380 us/op 0.76
bytes32 Buffer.toString(hex) 715.00 ns/op 792.00 ns/op 0.90
bytes32 Buffer.toString(hex) from Uint8Array 905.00 ns/op 1.1030 us/op 0.82
bytes32 Buffer.toString(hex) + 0x 684.00 ns/op 810.00 ns/op 0.84
Object access 1 prop 0.34100 ns/op 0.41400 ns/op 0.82
Map access 1 prop 0.29500 ns/op 0.33800 ns/op 0.87
Object get x1000 17.519 ns/op 16.438 ns/op 1.07
Map get x1000 1.0580 ns/op 0.94300 ns/op 1.12
Object set x1000 109.54 ns/op 116.08 ns/op 0.94
Map set x1000 67.457 ns/op 79.906 ns/op 0.84
Return object 10000 times 0.37610 ns/op 0.41480 ns/op 0.91
Throw Error 10000 times 5.9465 us/op 6.7019 us/op 0.89
enrSubnets - fastDeserialize 64 bits 911.00 ns/op 1.3030 us/op 0.70
enrSubnets - ssz BitVector 64 bits 608.00 ns/op 709.00 ns/op 0.86
enrSubnets - fastDeserialize 4 bits 415.00 ns/op 472.00 ns/op 0.88
enrSubnets - ssz BitVector 4 bits 625.00 ns/op 677.00 ns/op 0.92
RateTracker 1000000 limit, 1 obj count per request 183.67 ns/op 200.12 ns/op 0.92
RateTracker 1000000 limit, 2 obj count per request 137.91 ns/op 146.87 ns/op 0.94
RateTracker 1000000 limit, 4 obj count per request 115.15 ns/op 123.22 ns/op 0.93
RateTracker 1000000 limit, 8 obj count per request 103.05 ns/op 108.38 ns/op 0.95
RateTracker with prune 4.0720 us/op 4.9870 us/op 0.82
array of 16000 items push then shift 3.1646 us/op 5.0669 us/op 0.62
LinkedList of 16000 items push then shift 16.494 ns/op 20.752 ns/op 0.79
array of 16000 items push then pop 197.44 ns/op 239.39 ns/op 0.82
LinkedList of 16000 items push then pop 13.686 ns/op 20.842 ns/op 0.66
array of 24000 items push then shift 4.0397 us/op 7.5533 us/op 0.53
LinkedList of 24000 items push then shift 18.697 ns/op 20.814 ns/op 0.90
array of 24000 items push then pop 204.29 ns/op 223.48 ns/op 0.91
LinkedList of 24000 items push then pop 16.885 ns/op 19.546 ns/op 0.86

by benchmarkbot/action

@g11tech g11tech merged commit bdae023 into master Apr 7, 2022
@g11tech g11tech deleted the g11tech/mainnetshadowfork1 branch April 7, 2022 04:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants