test: fix multi-fork tests

[nazarhussain]

Motivation

Keep the tests stable.

Description

Fix the multi-fork sim tests.

Steps to test or reproduce

• Run all tests.

[codecov]

Codecov Report

Merging #6610 (afd869d) into unstable (ae9a32e) will not change coverage.
The diff coverage is n/a.

❗ Current head afd869d differs from pull request most recent head 0cd99a8. Consider uploading reports for the commit 0cd99a8 to get more accurate results

Additional details and impacted files

@@            Coverage Diff            @@
##           unstable    #6610   +/-   ##
=========================================
  Coverage     61.61%   61.61%           
=========================================
  Files           556      556           
  Lines         58567    58567           
  Branches       1859     1859           
=========================================
  Hits          36084    36084           
  Misses        22442    22442           
  Partials         41       41           

[nflaig]

LGTM

[nflaig]

Acutally, there is an error in multifork sim tests which looks related?

[github-actions]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for some benchmarks.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold.

Benchmark suite	Current: a10ab09	Previous: ae9a32e	Ratio
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42	30.493 us/op	9.0700 us/op	3.36

Full benchmark results

Benchmark suite	Current: a10ab09	Previous: ae9a32e	Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc	900.49 us/op	815.61 us/op	1.10
getPubkeys - validatorsArr - req 1000 vs - 250000 vc	121.36 us/op	50.791 us/op	2.39
BLS verify - blst-native	1.5014 ms/op	1.1008 ms/op	1.36
BLS verifyMultipleSignatures 3 - blst-native	3.1541 ms/op	2.3560 ms/op	1.34
BLS verifyMultipleSignatures 8 - blst-native	6.7726 ms/op	5.2268 ms/op	1.30
BLS verifyMultipleSignatures 32 - blst-native	25.295 ms/op	19.108 ms/op	1.32
BLS verifyMultipleSignatures 64 - blst-native	50.961 ms/op	37.449 ms/op	1.36
BLS verifyMultipleSignatures 128 - blst-native	99.576 ms/op	74.869 ms/op	1.33
BLS deserializing 10000 signatures	1.0122 s/op	790.49 ms/op	1.28
BLS deserializing 100000 signatures	9.8425 s/op	8.1474 s/op	1.21
BLS verifyMultipleSignatures - same message - 3 - blst-native	1.5365 ms/op	1.1537 ms/op	1.33
BLS verifyMultipleSignatures - same message - 8 - blst-native	1.5693 ms/op	1.3093 ms/op	1.20
BLS verifyMultipleSignatures - same message - 32 - blst-native	2.4410 ms/op	2.0544 ms/op	1.19
BLS verifyMultipleSignatures - same message - 64 - blst-native	3.6862 ms/op	3.9497 ms/op	0.93
BLS verifyMultipleSignatures - same message - 128 - blst-native	5.8663 ms/op	5.0164 ms/op	1.17
BLS aggregatePubkeys 32 - blst-native	26.968 us/op	22.945 us/op	1.18
BLS aggregatePubkeys 128 - blst-native	106.16 us/op	89.973 us/op	1.18
notSeenSlots=1 numMissedVotes=1 numBadVotes=10	65.466 ms/op	48.865 ms/op	1.34
notSeenSlots=1 numMissedVotes=0 numBadVotes=4	66.978 ms/op	45.323 ms/op	1.48
notSeenSlots=2 numMissedVotes=1 numBadVotes=10	52.708 ms/op	26.420 ms/op	2.00
getSlashingsAndExits - default max	172.63 us/op	124.12 us/op	1.39
getSlashingsAndExits - 2k	492.82 us/op	317.38 us/op	1.55
proposeBlockBody type=full, size=empty	6.3455 ms/op	4.2726 ms/op	1.49
isKnown best case - 1 super set check	356.00 ns/op	338.00 ns/op	1.05
isKnown normal case - 2 super set checks	326.00 ns/op	336.00 ns/op	0.97
isKnown worse case - 16 super set checks	311.00 ns/op	327.00 ns/op	0.95
InMemoryCheckpointStateCache - add get delete	7.0050 us/op	5.6420 us/op	1.24
validate api signedAggregateAndProof - struct	2.9191 ms/op	2.4508 ms/op	1.19
validate gossip signedAggregateAndProof - struct	2.9601 ms/op	2.4986 ms/op	1.18
validate gossip attestation - vc 640000	1.4353 ms/op	1.1492 ms/op	1.25
batch validate gossip attestation - vc 640000 - chunk 32	173.53 us/op	144.29 us/op	1.20
batch validate gossip attestation - vc 640000 - chunk 64	153.18 us/op	124.13 us/op	1.23
batch validate gossip attestation - vc 640000 - chunk 128	145.93 us/op	116.79 us/op	1.25
batch validate gossip attestation - vc 640000 - chunk 256	137.39 us/op	110.44 us/op	1.24
pickEth1Vote - no votes	1.2810 ms/op	917.18 us/op	1.40
pickEth1Vote - max votes	10.518 ms/op	9.8748 ms/op	1.07
pickEth1Vote - Eth1Data hashTreeRoot value x2048	18.131 ms/op	19.092 ms/op	0.95
pickEth1Vote - Eth1Data hashTreeRoot tree x2048	30.555 ms/op	31.121 ms/op	0.98
pickEth1Vote - Eth1Data fastSerialize value x2048	674.88 us/op	503.99 us/op	1.34
pickEth1Vote - Eth1Data fastSerialize tree x2048	6.0093 ms/op	5.4780 ms/op	1.10
bytes32 toHexString	554.00 ns/op	631.00 ns/op	0.88
bytes32 Buffer.toString(hex)	316.00 ns/op	387.00 ns/op	0.82
bytes32 Buffer.toString(hex) from Uint8Array	499.00 ns/op	528.00 ns/op	0.95
bytes32 Buffer.toString(hex) + 0x	313.00 ns/op	334.00 ns/op	0.94
Object access 1 prop	0.16600 ns/op	0.22200 ns/op	0.75
Map access 1 prop	0.16300 ns/op	0.19200 ns/op	0.85
Object get x1000	8.2480 ns/op	4.9440 ns/op	1.67
Map get x1000	0.91900 ns/op	0.86300 ns/op	1.06
Object set x1000	58.817 ns/op	30.089 ns/op	1.95
Map set x1000	45.717 ns/op	19.789 ns/op	2.31
Return object 10000 times	0.25780 ns/op	0.23160 ns/op	1.11
Throw Error 10000 times	4.0667 us/op	2.6969 us/op	1.51
fastMsgIdFn sha256 / 200 bytes	3.5150 us/op	2.0640 us/op	1.70
fastMsgIdFn h32 xxhash / 200 bytes	342.00 ns/op	360.00 ns/op	0.95
fastMsgIdFn h64 xxhash / 200 bytes	381.00 ns/op	379.00 ns/op	1.01
fastMsgIdFn sha256 / 1000 bytes	12.657 us/op	6.2390 us/op	2.03
fastMsgIdFn h32 xxhash / 1000 bytes	461.00 ns/op	499.00 ns/op	0.92
fastMsgIdFn h64 xxhash / 1000 bytes	452.00 ns/op	480.00 ns/op	0.94
fastMsgIdFn sha256 / 10000 bytes	107.05 us/op	51.756 us/op	2.07
fastMsgIdFn h32 xxhash / 10000 bytes	2.0280 us/op	1.8750 us/op	1.08
fastMsgIdFn h64 xxhash / 10000 bytes	1.3840 us/op	1.2870 us/op	1.08
send data - 1000 256B messages	17.758 ms/op	13.646 ms/op	1.30
send data - 1000 512B messages	29.520 ms/op	19.001 ms/op	1.55
send data - 1000 1024B messages	40.033 ms/op	25.474 ms/op	1.57
send data - 1000 1200B messages	43.700 ms/op	34.769 ms/op	1.26
send data - 1000 2048B messages	52.925 ms/op	44.112 ms/op	1.20
send data - 1000 4096B messages	44.318 ms/op	35.870 ms/op	1.24
send data - 1000 16384B messages	125.11 ms/op	85.533 ms/op	1.46
send data - 1000 65536B messages	523.96 ms/op	348.71 ms/op	1.50
enrSubnets - fastDeserialize 64 bits	1.4580 us/op	946.00 ns/op	1.54
enrSubnets - ssz BitVector 64 bits	443.00 ns/op	423.00 ns/op	1.05
enrSubnets - fastDeserialize 4 bits	204.00 ns/op	208.00 ns/op	0.98
enrSubnets - ssz BitVector 4 bits	461.00 ns/op	433.00 ns/op	1.06
prioritizePeers score -10:0 att 32-0.1 sync 2-0	122.14 us/op	65.890 us/op	1.85
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25	154.25 us/op	77.555 us/op	1.99
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5	176.04 us/op	108.42 us/op	1.62
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75	351.55 us/op	182.04 us/op	1.93
prioritizePeers score 0:0 att 64-1 sync 4-1	391.10 us/op	218.11 us/op	1.79
array of 16000 items push then shift	1.7525 us/op	1.3251 us/op	1.32
LinkedList of 16000 items push then shift	9.9400 ns/op	5.9570 ns/op	1.67
array of 16000 items push then pop	117.23 ns/op	52.349 ns/op	2.24
LinkedList of 16000 items push then pop	9.2090 ns/op	5.6930 ns/op	1.62
array of 24000 items push then shift	2.6266 us/op	1.9061 us/op	1.38
LinkedList of 24000 items push then shift	9.9620 ns/op	5.9120 ns/op	1.69
array of 24000 items push then pop	148.34 ns/op	93.435 ns/op	1.59
LinkedList of 24000 items push then pop	9.7280 ns/op	5.6900 ns/op	1.71
intersect bitArray bitLen 8	6.1290 ns/op	4.8350 ns/op	1.27
intersect array and set length 8	72.276 ns/op	49.005 ns/op	1.47
intersect bitArray bitLen 128	36.912 ns/op	29.273 ns/op	1.26
intersect array and set length 128	1.0146 us/op	688.55 ns/op	1.47
bitArray.getTrueBitIndexes() bitLen 128	1.7930 us/op	1.3170 us/op	1.36
bitArray.getTrueBitIndexes() bitLen 248	3.1530 us/op	2.0920 us/op	1.51
bitArray.getTrueBitIndexes() bitLen 512	5.8750 us/op	3.9630 us/op	1.48
Buffer.concat 32 items	1.2360 us/op	908.00 ns/op	1.36
Uint8Array.set 32 items	2.2530 us/op	1.6920 us/op	1.33
Set add up to 64 items then delete first	4.7702 us/op	1.7702 us/op	2.69
OrderedSet add up to 64 items then delete first	5.7775 us/op	2.7140 us/op	2.13
Set add up to 64 items then delete last	4.9981 us/op	2.0193 us/op	2.48
OrderedSet add up to 64 items then delete last	6.2980 us/op	3.0015 us/op	2.10
Set add up to 64 items then delete middle	5.2188 us/op	2.0145 us/op	2.59
OrderedSet add up to 64 items then delete middle	7.7112 us/op	4.2138 us/op	1.83
Set add up to 128 items then delete first	10.346 us/op	3.9834 us/op	2.60
OrderedSet add up to 128 items then delete first	13.896 us/op	6.2654 us/op	2.22
Set add up to 128 items then delete last	9.7727 us/op	3.8350 us/op	2.55
OrderedSet add up to 128 items then delete last	13.785 us/op	5.7914 us/op	2.38
Set add up to 128 items then delete middle	9.9407 us/op	3.8158 us/op	2.61
OrderedSet add up to 128 items then delete middle	18.586 us/op	10.619 us/op	1.75
Set add up to 256 items then delete first	22.060 us/op	7.7143 us/op	2.86
OrderedSet add up to 256 items then delete first	29.472 us/op	12.253 us/op	2.41
Set add up to 256 items then delete last	19.836 us/op	7.5889 us/op	2.61
OrderedSet add up to 256 items then delete last	25.181 us/op	11.405 us/op	2.21
Set add up to 256 items then delete middle	19.368 us/op	7.4337 us/op	2.61
OrderedSet add up to 256 items then delete middle	51.861 us/op	30.444 us/op	1.70
transfer serialized Status (84 B)	1.8530 us/op	1.3900 us/op	1.33
copy serialized Status (84 B)	1.3770 us/op	1.0420 us/op	1.32
transfer serialized SignedVoluntaryExit (112 B)	2.0020 us/op	1.3810 us/op	1.45
copy serialized SignedVoluntaryExit (112 B)	1.4450 us/op	1.0370 us/op	1.39
transfer serialized ProposerSlashing (416 B)	2.2050 us/op	1.8910 us/op	1.17
copy serialized ProposerSlashing (416 B)	1.8670 us/op	1.6040 us/op	1.16
transfer serialized Attestation (485 B)	2.2800 us/op	1.7900 us/op	1.27
copy serialized Attestation (485 B)	1.9520 us/op	1.6510 us/op	1.18
transfer serialized AttesterSlashing (33232 B)	2.1210 us/op	1.9410 us/op	1.09
copy serialized AttesterSlashing (33232 B)	4.9880 us/op	3.7800 us/op	1.32
transfer serialized Small SignedBeaconBlock (128000 B)	2.5410 us/op	2.2000 us/op	1.16
copy serialized Small SignedBeaconBlock (128000 B)	14.523 us/op	8.9550 us/op	1.62
transfer serialized Avg SignedBeaconBlock (200000 B)	2.9800 us/op	2.0240 us/op	1.47
copy serialized Avg SignedBeaconBlock (200000 B)	20.460 us/op	12.330 us/op	1.66
transfer serialized BlobsSidecar (524380 B)	2.9280 us/op	2.8510 us/op	1.03
copy serialized BlobsSidecar (524380 B)	90.741 us/op	115.48 us/op	0.79
transfer serialized Big SignedBeaconBlock (1000000 B)	3.0470 us/op	2.9190 us/op	1.04
copy serialized Big SignedBeaconBlock (1000000 B)	202.56 us/op	195.40 us/op	1.04
pass gossip attestations to forkchoice per slot	5.0272 ms/op	2.7948 ms/op	1.80
forkChoice updateHead vc 100000 bc 64 eq 0	710.42 us/op	455.75 us/op	1.56
forkChoice updateHead vc 600000 bc 64 eq 0	5.2047 ms/op	2.8649 ms/op	1.82
forkChoice updateHead vc 1000000 bc 64 eq 0	7.4896 ms/op	4.3219 ms/op	1.73
forkChoice updateHead vc 600000 bc 320 eq 0	4.3037 ms/op	2.5920 ms/op	1.66
forkChoice updateHead vc 600000 bc 1200 eq 0	4.4756 ms/op	2.7201 ms/op	1.65
forkChoice updateHead vc 600000 bc 7200 eq 0	5.6335 ms/op	3.4657 ms/op	1.63
forkChoice updateHead vc 600000 bc 64 eq 1000	11.466 ms/op	9.8602 ms/op	1.16
forkChoice updateHead vc 600000 bc 64 eq 10000	12.391 ms/op	9.7000 ms/op	1.28
forkChoice updateHead vc 600000 bc 64 eq 300000	16.710 ms/op	12.076 ms/op	1.38
computeDeltas 500000 validators 300 proto nodes	7.1754 ms/op	3.2174 ms/op	2.23
computeDeltas 500000 validators 1200 proto nodes	7.0902 ms/op	3.0228 ms/op	2.35
computeDeltas 500000 validators 7200 proto nodes	7.0320 ms/op	2.9046 ms/op	2.42
computeDeltas 750000 validators 300 proto nodes	10.255 ms/op	4.4499 ms/op	2.30
computeDeltas 750000 validators 1200 proto nodes	10.490 ms/op	4.4494 ms/op	2.36
computeDeltas 750000 validators 7200 proto nodes	10.811 ms/op	4.4380 ms/op	2.44
computeDeltas 1400000 validators 300 proto nodes	21.783 ms/op	8.6360 ms/op	2.52
computeDeltas 1400000 validators 1200 proto nodes	20.491 ms/op	8.7624 ms/op	2.34
computeDeltas 1400000 validators 7200 proto nodes	21.009 ms/op	8.6913 ms/op	2.42
computeDeltas 2100000 validators 300 proto nodes	30.940 ms/op	13.147 ms/op	2.35
computeDeltas 2100000 validators 1200 proto nodes	31.664 ms/op	12.959 ms/op	2.44
computeDeltas 2100000 validators 7200 proto nodes	35.551 ms/op	12.875 ms/op	2.76
altair processAttestation - 250000 vs - 7PWei normalcase	3.4244 ms/op	1.5261 ms/op	2.24
altair processAttestation - 250000 vs - 7PWei worstcase	5.7219 ms/op	2.1160 ms/op	2.70
altair processAttestation - setStatus - 1/6 committees join	174.15 us/op	78.413 us/op	2.22
altair processAttestation - setStatus - 1/3 committees join	359.73 us/op	154.08 us/op	2.33
altair processAttestation - setStatus - 1/2 committees join	561.25 us/op	228.36 us/op	2.46
altair processAttestation - setStatus - 2/3 committees join	683.64 us/op	281.55 us/op	2.43
altair processAttestation - setStatus - 4/5 committees join	965.86 us/op	413.12 us/op	2.34
altair processAttestation - setStatus - 100% committees join	1.1403 ms/op	491.36 us/op	2.32
altair processBlock - 250000 vs - 7PWei normalcase	11.196 ms/op	6.2839 ms/op	1.78
altair processBlock - 250000 vs - 7PWei normalcase hashState	50.425 ms/op	28.017 ms/op	1.80
altair processBlock - 250000 vs - 7PWei worstcase	57.726 ms/op	29.292 ms/op	1.97
altair processBlock - 250000 vs - 7PWei worstcase hashState	132.50 ms/op	86.101 ms/op	1.54
phase0 processBlock - 250000 vs - 7PWei normalcase	3.6670 ms/op	1.9593 ms/op	1.87
phase0 processBlock - 250000 vs - 7PWei worstcase	45.112 ms/op	23.535 ms/op	1.92
altair processEth1Data - 250000 vs - 7PWei normalcase	679.68 us/op	261.24 us/op	2.60
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15	17.684 us/op	6.2290 us/op	2.84
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219	78.785 us/op	57.587 us/op	1.37
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42	30.493 us/op	9.0700 us/op	3.36
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18	12.992 us/op	5.2860 us/op	2.46
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020	188.94 us/op	151.11 us/op	1.25
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777	2.0328 ms/op	1.0015 ms/op	2.03
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384	2.6955 ms/op	1.4502 ms/op	1.86
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384	2.6859 ms/op	922.78 us/op	2.91
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384	4.1904 ms/op	2.4240 ms/op	1.73
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384	3.5683 ms/op	1.4472 ms/op	2.47
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384	7.5087 ms/op	3.4383 ms/op	2.18
Tree 40 250000 create	533.16 ms/op	260.63 ms/op	2.05
Tree 40 250000 get(125000)	264.87 ns/op	106.62 ns/op	2.48
Tree 40 250000 set(125000)	1.2533 us/op	759.25 ns/op	1.65
Tree 40 250000 toArray()	24.533 ms/op	15.666 ms/op	1.57
Tree 40 250000 iterate all - toArray() + loop	24.142 ms/op	17.408 ms/op	1.39
Tree 40 250000 iterate all - get(i)	81.740 ms/op	41.491 ms/op	1.97
MutableVector 250000 create	18.433 ms/op	11.652 ms/op	1.58
MutableVector 250000 get(125000)	7.3510 ns/op	5.5070 ns/op	1.33
MutableVector 250000 set(125000)	331.12 ns/op	201.19 ns/op	1.65
MutableVector 250000 toArray()	4.1657 ms/op	2.4350 ms/op	1.71
MutableVector 250000 iterate all - toArray() + loop	4.5695 ms/op	2.2410 ms/op	2.04
MutableVector 250000 iterate all - get(i)	1.6733 ms/op	1.3392 ms/op	1.25
Array 250000 create	4.1508 ms/op	2.3081 ms/op	1.80
Array 250000 clone - spread	1.6900 ms/op	1.0832 ms/op	1.56
Array 250000 get(125000)	1.9680 ns/op	0.99700 ns/op	1.97
Array 250000 set(125000)	6.6380 ns/op	1.1910 ns/op	5.57
Array 250000 iterate all - loop	202.83 us/op	146.14 us/op	1.39
effectiveBalanceIncrements clone Uint8Array 300000	70.931 us/op	19.436 us/op	3.65
effectiveBalanceIncrements clone MutableVector 300000	566.00 ns/op	405.00 ns/op	1.40
effectiveBalanceIncrements rw all Uint8Array 300000	244.50 us/op	175.88 us/op	1.39
effectiveBalanceIncrements rw all MutableVector 300000	204.66 ms/op	65.506 ms/op	3.12
phase0 afterProcessEpoch - 250000 vs - 7PWei	148.29 ms/op	74.732 ms/op	1.98
phase0 beforeProcessEpoch - 250000 vs - 7PWei	50.164 ms/op	43.537 ms/op	1.15
altair processEpoch - mainnet_e81889	597.32 ms/op	425.21 ms/op	1.40
mainnet_e81889 - altair beforeProcessEpoch	115.84 ms/op	67.229 ms/op	1.72
mainnet_e81889 - altair processJustificationAndFinalization	29.669 us/op	8.7360 us/op	3.40
mainnet_e81889 - altair processInactivityUpdates	7.2246 ms/op	3.9597 ms/op	1.82
mainnet_e81889 - altair processRewardsAndPenalties	74.273 ms/op	64.131 ms/op	1.16
mainnet_e81889 - altair processRegistryUpdates	3.4200 us/op	1.9160 us/op	1.78
mainnet_e81889 - altair processSlashings	1.6200 us/op	592.00 ns/op	2.74
mainnet_e81889 - altair processEth1DataReset	880.00 ns/op	393.00 ns/op	2.24
mainnet_e81889 - altair processEffectiveBalanceUpdates	2.0358 ms/op	1.0217 ms/op	1.99
mainnet_e81889 - altair processSlashingsReset	6.7770 us/op	1.5650 us/op	4.33
mainnet_e81889 - altair processRandaoMixesReset	10.078 us/op	3.5630 us/op	2.83
mainnet_e81889 - altair processHistoricalRootsUpdate	1.7940 us/op	799.00 ns/op	2.25
mainnet_e81889 - altair processParticipationFlagUpdates	4.7220 us/op	1.4020 us/op	3.37
mainnet_e81889 - altair processSyncCommitteeUpdates	2.0620 us/op	615.00 ns/op	3.35
mainnet_e81889 - altair afterProcessEpoch	157.66 ms/op	77.957 ms/op	2.02
capella processEpoch - mainnet_e217614	3.0852 s/op	1.6986 s/op	1.82
mainnet_e217614 - capella beforeProcessEpoch	707.91 ms/op	411.95 ms/op	1.72
mainnet_e217614 - capella processJustificationAndFinalization	28.604 us/op	10.564 us/op	2.71
mainnet_e217614 - capella processInactivityUpdates	23.068 ms/op	13.529 ms/op	1.70
mainnet_e217614 - capella processRewardsAndPenalties	699.09 ms/op	451.20 ms/op	1.55
mainnet_e217614 - capella processRegistryUpdates	27.521 us/op	18.946 us/op	1.45
mainnet_e217614 - capella processSlashings	941.00 ns/op	645.00 ns/op	1.46
mainnet_e217614 - capella processEth1DataReset	663.00 ns/op	617.00 ns/op	1.07
mainnet_e217614 - capella processEffectiveBalanceUpdates	5.3060 ms/op	3.4842 ms/op	1.52
mainnet_e217614 - capella processSlashingsReset	6.0400 us/op	1.9560 us/op	3.09
mainnet_e217614 - capella processRandaoMixesReset	7.9160 us/op	3.6440 us/op	2.17
mainnet_e217614 - capella processHistoricalRootsUpdate	1.1530 us/op	706.00 ns/op	1.63
mainnet_e217614 - capella processParticipationFlagUpdates	3.9220 us/op	1.5210 us/op	2.58
mainnet_e217614 - capella afterProcessEpoch	415.71 ms/op	227.43 ms/op	1.83
phase0 processEpoch - mainnet_e58758	624.60 ms/op	382.88 ms/op	1.63
mainnet_e58758 - phase0 beforeProcessEpoch	204.15 ms/op	121.53 ms/op	1.68
mainnet_e58758 - phase0 processJustificationAndFinalization	28.781 us/op	10.138 us/op	2.84
mainnet_e58758 - phase0 processRewardsAndPenalties	81.989 ms/op	66.107 ms/op	1.24
mainnet_e58758 - phase0 processRegistryUpdates	16.481 us/op	7.7260 us/op	2.13
mainnet_e58758 - phase0 processSlashings	782.00 ns/op	603.00 ns/op	1.30
mainnet_e58758 - phase0 processEth1DataReset	744.00 ns/op	627.00 ns/op	1.19
mainnet_e58758 - phase0 processEffectiveBalanceUpdates	1.2937 ms/op	1.3492 ms/op	0.96
mainnet_e58758 - phase0 processSlashingsReset	5.2660 us/op	2.4270 us/op	2.17
mainnet_e58758 - phase0 processRandaoMixesReset	7.2770 us/op	2.6050 us/op	2.79
mainnet_e58758 - phase0 processHistoricalRootsUpdate	967.00 ns/op	543.00 ns/op	1.78
mainnet_e58758 - phase0 processParticipationRecordUpdates	6.7760 us/op	3.1020 us/op	2.18
mainnet_e58758 - phase0 afterProcessEpoch	120.27 ms/op	64.489 ms/op	1.86
phase0 processEffectiveBalanceUpdates - 250000 normalcase	1.7479 ms/op	939.03 us/op	1.86
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5	2.2287 ms/op	1.1377 ms/op	1.96
altair processInactivityUpdates - 250000 normalcase	39.837 ms/op	25.037 ms/op	1.59
altair processInactivityUpdates - 250000 worstcase	37.908 ms/op	25.030 ms/op	1.51
phase0 processRegistryUpdates - 250000 normalcase	14.278 us/op	5.4530 us/op	2.62
phase0 processRegistryUpdates - 250000 badcase_full_deposits	538.64 us/op	432.67 us/op	1.24
phase0 processRegistryUpdates - 250000 worstcase 0.5	146.42 ms/op	113.76 ms/op	1.29
altair processRewardsAndPenalties - 250000 normalcase	91.433 ms/op	64.942 ms/op	1.41
altair processRewardsAndPenalties - 250000 worstcase	83.782 ms/op	74.612 ms/op	1.12
phase0 getAttestationDeltas - 250000 normalcase	11.759 ms/op	5.6824 ms/op	2.07
phase0 getAttestationDeltas - 250000 worstcase	13.177 ms/op	5.7214 ms/op	2.30
phase0 processSlashings - 250000 worstcase	115.61 us/op	80.518 us/op	1.44
altair processSyncCommitteeUpdates - 250000	182.56 ms/op	107.49 ms/op	1.70
BeaconState.hashTreeRoot - No change	635.00 ns/op	381.00 ns/op	1.67
BeaconState.hashTreeRoot - 1 full validator	151.67 us/op	134.38 us/op	1.13
BeaconState.hashTreeRoot - 32 full validator	1.8114 ms/op	1.6567 ms/op	1.09
BeaconState.hashTreeRoot - 512 full validator	22.682 ms/op	17.491 ms/op	1.30
BeaconState.hashTreeRoot - 1 validator.effectiveBalance	263.98 us/op	187.50 us/op	1.41
BeaconState.hashTreeRoot - 32 validator.effectiveBalance	3.0376 ms/op	2.5933 ms/op	1.17
BeaconState.hashTreeRoot - 512 validator.effectiveBalance	41.624 ms/op	27.407 ms/op	1.52
BeaconState.hashTreeRoot - 1 balances	171.66 us/op	119.19 us/op	1.44
BeaconState.hashTreeRoot - 32 balances	1.7096 ms/op	1.1263 ms/op	1.52
BeaconState.hashTreeRoot - 512 balances	17.301 ms/op	11.896 ms/op	1.45
BeaconState.hashTreeRoot - 250000 balances	262.76 ms/op	188.72 ms/op	1.39
aggregationBits - 2048 els - zipIndexesInBitList	40.100 us/op	20.362 us/op	1.97
byteArrayEquals 32	80.976 ns/op	61.841 ns/op	1.31
Buffer.compare 32	59.254 ns/op	35.187 ns/op	1.68
byteArrayEquals 1024	2.2867 us/op	1.6450 us/op	1.39
Buffer.compare 1024	87.889 ns/op	41.749 ns/op	2.11
byteArrayEquals 16384	38.645 us/op	26.491 us/op	1.46
Buffer.compare 16384	306.02 ns/op	211.31 ns/op	1.45
byteArrayEquals 123687377	332.34 ms/op	200.16 ms/op	1.66
Buffer.compare 123687377	13.299 ms/op	5.3930 ms/op	2.47
byteArrayEquals 32 - diff last byte	97.539 ns/op	59.280 ns/op	1.65
Buffer.compare 32 - diff last byte	76.200 ns/op	35.912 ns/op	2.12
byteArrayEquals 1024 - diff last byte	2.8772 us/op	1.6784 us/op	1.71
Buffer.compare 1024 - diff last byte	97.007 ns/op	42.305 ns/op	2.29
byteArrayEquals 16384 - diff last byte	42.159 us/op	26.123 us/op	1.61
Buffer.compare 16384 - diff last byte	380.82 ns/op	180.90 ns/op	2.11
byteArrayEquals 123687377 - diff last byte	298.85 ms/op	198.09 ms/op	1.51
Buffer.compare 123687377 - diff last byte	9.1910 ms/op	3.7863 ms/op	2.43
byteArrayEquals 32 - random bytes	7.1070 ns/op	4.7000 ns/op	1.51
Buffer.compare 32 - random bytes	69.234 ns/op	39.686 ns/op	1.74
byteArrayEquals 1024 - random bytes	6.9790 ns/op	4.5330 ns/op	1.54
Buffer.compare 1024 - random bytes	69.276 ns/op	38.155 ns/op	1.82
byteArrayEquals 16384 - random bytes	7.0230 ns/op	4.5110 ns/op	1.56
Buffer.compare 16384 - random bytes	68.651 ns/op	38.261 ns/op	1.79
byteArrayEquals 123687377 - random bytes	10.260 ns/op	8.1000 ns/op	1.27
Buffer.compare 123687377 - random bytes	81.150 ns/op	42.560 ns/op	1.91
regular array get 100000 times	51.437 us/op	41.676 us/op	1.23
wrappedArray get 100000 times	50.892 us/op	41.567 us/op	1.22
arrayWithProxy get 100000 times	16.986 ms/op	10.503 ms/op	1.62
ssz.Root.equals	60.470 ns/op	55.190 ns/op	1.10
byteArrayEquals	61.966 ns/op	54.080 ns/op	1.15
Buffer.compare	12.939 ns/op	9.4180 ns/op	1.37
shuffle list - 16384 els	10.047 ms/op	5.8137 ms/op	1.73
shuffle list - 250000 els	145.80 ms/op	85.537 ms/op	1.70
processSlot - 1 slots	18.695 us/op	16.217 us/op	1.15
processSlot - 32 slots	4.9844 ms/op	3.8945 ms/op	1.28
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei	68.920 ms/op	54.925 ms/op	1.25
getCommitteeAssignments - req 1 vs - 250000 vc	3.2158 ms/op	2.3099 ms/op	1.39
getCommitteeAssignments - req 100 vs - 250000 vc	4.9310 ms/op	3.4355 ms/op	1.44
getCommitteeAssignments - req 1000 vs - 250000 vc	5.2606 ms/op	3.6806 ms/op	1.43
findModifiedValidators - 10000 modified validators	438.67 ms/op	308.07 ms/op	1.42
findModifiedValidators - 1000 modified validators	310.07 ms/op	156.19 ms/op	1.99
findModifiedValidators - 100 modified validators	299.07 ms/op	138.93 ms/op	2.15
findModifiedValidators - 10 modified validators	283.41 ms/op	136.58 ms/op	2.08
findModifiedValidators - 1 modified validators	278.29 ms/op	141.89 ms/op	1.96
findModifiedValidators - no difference	296.40 ms/op	159.32 ms/op	1.86
compare ViewDUs	5.5910 s/op	3.9928 s/op	1.40
compare each validator Uint8Array	1.7467 s/op	1.4404 s/op	1.21
compare ViewDU to Uint8Array	1.8150 s/op	812.19 ms/op	2.23
migrate state 1000000 validators, 24 modified, 0 new	1.0440 s/op	734.55 ms/op	1.42
migrate state 1000000 validators, 1700 modified, 1000 new	1.4178 s/op	1.0099 s/op	1.40
migrate state 1000000 validators, 3400 modified, 2000 new	1.9386 s/op	1.1528 s/op	1.68
migrate state 1500000 validators, 24 modified, 0 new	1.1857 s/op	586.42 ms/op	2.02
migrate state 1500000 validators, 1700 modified, 1000 new	1.5873 s/op	994.83 ms/op	1.60
migrate state 1500000 validators, 3400 modified, 2000 new	1.7904 s/op	1.2057 s/op	1.48
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei	6.0800 ns/op	4.5000 ns/op	1.35
state getBlockRootAtSlot - 250000 vs - 7PWei	817.03 ns/op	638.94 ns/op	1.28
computeProposers - vc 250000	10.742 ms/op	7.0448 ms/op	1.52
computeEpochShuffling - vc 250000	155.77 ms/op	86.495 ms/op	1.80
getNextSyncCommittee - vc 250000	188.77 ms/op	120.73 ms/op	1.56
computeSigningRoot for AttestationData	29.664 us/op	25.005 us/op	1.19
hash AttestationData serialized data then Buffer.toString(base64)	2.7238 us/op	1.2521 us/op	2.18
toHexString serialized data	1.2564 us/op	860.19 ns/op	1.46
Buffer.toString(base64)	266.60 ns/op	159.95 ns/op	1.67

by benchmarkbot/action

[nazarhussain]

Acutally, there is an error in multifork sim tests which looks related?

It's not related to this PR. I observed it only few times, it's stating that tracker didn't closed before the node shutdown. Will look that error separately.

[wemeetagain]

🎉 This PR is included in v1.18.0 🎉