fix: checkpoint state cache grafana panel labels #6618
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
nflaig
approved these changes
Apr 1, 2024
|
| Benchmark suite | Current: 2c3f213 | Previous: b81230a | Ratio |
|---|---|---|---|
| Map set x1000 | 53.896 ns/op | 17.432 ns/op | 3.09 |
Full benchmark results
| Benchmark suite | Current: 2c3f213 | Previous: b81230a | Ratio |
|---|---|---|---|
| getPubkeys - index2pubkey - req 1000 vs - 250000 vc | 880.93 us/op | 741.24 us/op | 1.19 |
| getPubkeys - validatorsArr - req 1000 vs - 250000 vc | 130.87 us/op | 61.951 us/op | 2.11 |
| BLS verify - blst-native | 1.3941 ms/op | 1.1410 ms/op | 1.22 |
| BLS verifyMultipleSignatures 3 - blst-native | 2.8853 ms/op | 2.4279 ms/op | 1.19 |
| BLS verifyMultipleSignatures 8 - blst-native | 6.4206 ms/op | 5.3841 ms/op | 1.19 |
| BLS verifyMultipleSignatures 32 - blst-native | 24.009 ms/op | 19.738 ms/op | 1.22 |
| BLS verifyMultipleSignatures 64 - blst-native | 45.641 ms/op | 38.863 ms/op | 1.17 |
| BLS verifyMultipleSignatures 128 - blst-native | 89.817 ms/op | 77.105 ms/op | 1.16 |
| BLS deserializing 10000 signatures | 1.0207 s/op | 805.05 ms/op | 1.27 |
| BLS deserializing 100000 signatures | 9.4951 s/op | 8.4903 s/op | 1.12 |
| BLS verifyMultipleSignatures - same message - 3 - blst-native | 1.4565 ms/op | 1.1497 ms/op | 1.27 |
| BLS verifyMultipleSignatures - same message - 8 - blst-native | 1.6381 ms/op | 1.2859 ms/op | 1.27 |
| BLS verifyMultipleSignatures - same message - 32 - blst-native | 2.4377 ms/op | 2.4091 ms/op | 1.01 |
| BLS verifyMultipleSignatures - same message - 64 - blst-native | 3.7202 ms/op | 4.0299 ms/op | 0.92 |
| BLS verifyMultipleSignatures - same message - 128 - blst-native | 5.9681 ms/op | 5.0512 ms/op | 1.18 |
| BLS aggregatePubkeys 32 - blst-native | 27.889 us/op | 22.984 us/op | 1.21 |
| BLS aggregatePubkeys 128 - blst-native | 108.06 us/op | 87.589 us/op | 1.23 |
| notSeenSlots=1 numMissedVotes=1 numBadVotes=10 | 85.375 ms/op | 44.246 ms/op | 1.93 |
| notSeenSlots=1 numMissedVotes=0 numBadVotes=4 | 90.531 ms/op | 44.429 ms/op | 2.04 |
| notSeenSlots=2 numMissedVotes=1 numBadVotes=10 | 51.866 ms/op | 26.388 ms/op | 1.97 |
| getSlashingsAndExits - default max | 176.16 us/op | 137.94 us/op | 1.28 |
| getSlashingsAndExits - 2k | 535.04 us/op | 349.59 us/op | 1.53 |
| proposeBlockBody type=full, size=empty | 7.2720 ms/op | 4.2919 ms/op | 1.69 |
| isKnown best case - 1 super set check | 640.00 ns/op | 331.00 ns/op | 1.93 |
| isKnown normal case - 2 super set checks | 648.00 ns/op | 348.00 ns/op | 1.86 |
| isKnown worse case - 16 super set checks | 535.00 ns/op | 333.00 ns/op | 1.61 |
| InMemoryCheckpointStateCache - add get delete | 8.5280 us/op | 3.9940 us/op | 2.14 |
| validate api signedAggregateAndProof - struct | 2.8533 ms/op | 2.4774 ms/op | 1.15 |
| validate gossip signedAggregateAndProof - struct | 2.8740 ms/op | 2.3996 ms/op | 1.20 |
| validate gossip attestation - vc 640000 | 1.4110 ms/op | 1.1623 ms/op | 1.21 |
| batch validate gossip attestation - vc 640000 - chunk 32 | 174.64 us/op | 145.01 us/op | 1.20 |
| batch validate gossip attestation - vc 640000 - chunk 64 | 156.61 us/op | 129.92 us/op | 1.21 |
| batch validate gossip attestation - vc 640000 - chunk 128 | 145.32 us/op | 129.64 us/op | 1.12 |
| batch validate gossip attestation - vc 640000 - chunk 256 | 143.95 us/op | 120.62 us/op | 1.19 |
| pickEth1Vote - no votes | 1.3179 ms/op | 855.88 us/op | 1.54 |
| pickEth1Vote - max votes | 13.098 ms/op | 8.1741 ms/op | 1.60 |
| pickEth1Vote - Eth1Data hashTreeRoot value x2048 | 21.276 ms/op | 14.227 ms/op | 1.50 |
| pickEth1Vote - Eth1Data hashTreeRoot tree x2048 | 27.858 ms/op | 29.003 ms/op | 0.96 |
| pickEth1Vote - Eth1Data fastSerialize value x2048 | 719.61 us/op | 560.04 us/op | 1.28 |
| pickEth1Vote - Eth1Data fastSerialize tree x2048 | 5.4969 ms/op | 3.3175 ms/op | 1.66 |
| bytes32 toHexString | 618.00 ns/op | 501.00 ns/op | 1.23 |
| bytes32 Buffer.toString(hex) | 311.00 ns/op | 321.00 ns/op | 0.97 |
| bytes32 Buffer.toString(hex) from Uint8Array | 533.00 ns/op | 426.00 ns/op | 1.25 |
| bytes32 Buffer.toString(hex) + 0x | 308.00 ns/op | 310.00 ns/op | 0.99 |
| Object access 1 prop | 0.20600 ns/op | 0.20400 ns/op | 1.01 |
| Map access 1 prop | 0.16400 ns/op | 0.19900 ns/op | 0.82 |
| Object get x1000 | 8.1570 ns/op | 5.4780 ns/op | 1.49 |
| Map get x1000 | 0.89000 ns/op | 0.72400 ns/op | 1.23 |
| Object set x1000 | 75.208 ns/op | 28.919 ns/op | 2.60 |
| Map set x1000 | 53.896 ns/op | 17.432 ns/op | 3.09 |
| Return object 10000 times | 0.25520 ns/op | 0.23100 ns/op | 1.10 |
| Throw Error 10000 times | 4.0565 us/op | 2.8331 us/op | 1.43 |
| fastMsgIdFn sha256 / 200 bytes | 3.5170 us/op | 2.0300 us/op | 1.73 |
| fastMsgIdFn h32 xxhash / 200 bytes | 355.00 ns/op | 328.00 ns/op | 1.08 |
| fastMsgIdFn h64 xxhash / 200 bytes | 401.00 ns/op | 363.00 ns/op | 1.10 |
| fastMsgIdFn sha256 / 1000 bytes | 11.911 us/op | 6.0280 us/op | 1.98 |
| fastMsgIdFn h32 xxhash / 1000 bytes | 483.00 ns/op | 414.00 ns/op | 1.17 |
| fastMsgIdFn h64 xxhash / 1000 bytes | 474.00 ns/op | 441.00 ns/op | 1.07 |
| fastMsgIdFn sha256 / 10000 bytes | 106.68 us/op | 50.785 us/op | 2.10 |
| fastMsgIdFn h32 xxhash / 10000 bytes | 2.0710 us/op | 1.8180 us/op | 1.14 |
| fastMsgIdFn h64 xxhash / 10000 bytes | 1.4070 us/op | 1.2320 us/op | 1.14 |
| send data - 1000 256B messages | 21.656 ms/op | 14.790 ms/op | 1.46 |
| send data - 1000 512B messages | 27.910 ms/op | 16.629 ms/op | 1.68 |
| send data - 1000 1024B messages | 40.685 ms/op | 21.103 ms/op | 1.93 |
| send data - 1000 1200B messages | 42.176 ms/op | 28.999 ms/op | 1.45 |
| send data - 1000 2048B messages | 54.581 ms/op | 36.765 ms/op | 1.48 |
| send data - 1000 4096B messages | 50.902 ms/op | 33.128 ms/op | 1.54 |
| send data - 1000 16384B messages | 120.30 ms/op | 91.816 ms/op | 1.31 |
| send data - 1000 65536B messages | 498.40 ms/op | 402.92 ms/op | 1.24 |
| enrSubnets - fastDeserialize 64 bits | 1.5930 us/op | 928.00 ns/op | 1.72 |
| enrSubnets - ssz BitVector 64 bits | 527.00 ns/op | 429.00 ns/op | 1.23 |
| enrSubnets - fastDeserialize 4 bits | 220.00 ns/op | 216.00 ns/op | 1.02 |
| enrSubnets - ssz BitVector 4 bits | 526.00 ns/op | 441.00 ns/op | 1.19 |
| prioritizePeers score -10:0 att 32-0.1 sync 2-0 | 113.48 us/op | 67.568 us/op | 1.68 |
| prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 | 148.43 us/op | 81.496 us/op | 1.82 |
| prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 | 182.03 us/op | 108.46 us/op | 1.68 |
| prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 | 335.28 us/op | 178.89 us/op | 1.87 |
| prioritizePeers score 0:0 att 64-1 sync 4-1 | 384.51 us/op | 205.41 us/op | 1.87 |
| array of 16000 items push then shift | 1.7063 us/op | 1.2302 us/op | 1.39 |
| LinkedList of 16000 items push then shift | 9.3490 ns/op | 6.9290 ns/op | 1.35 |
| array of 16000 items push then pop | 102.58 ns/op | 60.699 ns/op | 1.69 |
| LinkedList of 16000 items push then pop | 9.0140 ns/op | 5.6850 ns/op | 1.59 |
| array of 24000 items push then shift | 2.5330 us/op | 1.7844 us/op | 1.42 |
| LinkedList of 24000 items push then shift | 9.4140 ns/op | 6.4850 ns/op | 1.45 |
| array of 24000 items push then pop | 146.37 ns/op | 91.083 ns/op | 1.61 |
| LinkedList of 24000 items push then pop | 9.2510 ns/op | 5.5240 ns/op | 1.67 |
| intersect bitArray bitLen 8 | 6.0470 ns/op | 4.5110 ns/op | 1.34 |
| intersect array and set length 8 | 67.928 ns/op | 46.142 ns/op | 1.47 |
| intersect bitArray bitLen 128 | 37.014 ns/op | 27.569 ns/op | 1.34 |
| intersect array and set length 128 | 1.0016 us/op | 641.29 ns/op | 1.56 |
| bitArray.getTrueBitIndexes() bitLen 128 | 1.7250 us/op | 1.1740 us/op | 1.47 |
| bitArray.getTrueBitIndexes() bitLen 248 | 2.9710 us/op | 1.9920 us/op | 1.49 |
| bitArray.getTrueBitIndexes() bitLen 512 | 5.8080 us/op | 3.7650 us/op | 1.54 |
| Buffer.concat 32 items | 1.0880 us/op | 819.00 ns/op | 1.33 |
| Uint8Array.set 32 items | 1.7850 us/op | 2.3360 us/op | 0.76 |
| Set add up to 64 items then delete first | 4.7596 us/op | 1.6373 us/op | 2.91 |
| OrderedSet add up to 64 items then delete first | 6.2462 us/op | 2.4929 us/op | 2.51 |
| Set add up to 64 items then delete last | 5.3832 us/op | 1.8568 us/op | 2.90 |
| OrderedSet add up to 64 items then delete last | 6.7234 us/op | 2.9089 us/op | 2.31 |
| Set add up to 64 items then delete middle | 5.4023 us/op | 1.8645 us/op | 2.90 |
| OrderedSet add up to 64 items then delete middle | 7.9908 us/op | 3.9968 us/op | 2.00 |
| Set add up to 128 items then delete first | 10.451 us/op | 3.5988 us/op | 2.90 |
| OrderedSet add up to 128 items then delete first | 14.069 us/op | 5.4186 us/op | 2.60 |
| Set add up to 128 items then delete last | 10.338 us/op | 3.5835 us/op | 2.88 |
| OrderedSet add up to 128 items then delete last | 12.740 us/op | 5.6539 us/op | 2.25 |
| Set add up to 128 items then delete middle | 10.013 us/op | 3.5580 us/op | 2.81 |
| OrderedSet add up to 128 items then delete middle | 17.433 us/op | 10.136 us/op | 1.72 |
| Set add up to 256 items then delete first | 19.137 us/op | 7.0961 us/op | 2.70 |
| OrderedSet add up to 256 items then delete first | 25.734 us/op | 10.872 us/op | 2.37 |
| Set add up to 256 items then delete last | 18.418 us/op | 7.1092 us/op | 2.59 |
| OrderedSet add up to 256 items then delete last | 23.526 us/op | 11.335 us/op | 2.08 |
| Set add up to 256 items then delete middle | 18.569 us/op | 7.0789 us/op | 2.62 |
| OrderedSet add up to 256 items then delete middle | 45.963 us/op | 28.912 us/op | 1.59 |
| transfer serialized Status (84 B) | 1.9030 us/op | 1.3790 us/op | 1.38 |
| copy serialized Status (84 B) | 1.4220 us/op | 1.1690 us/op | 1.22 |
| transfer serialized SignedVoluntaryExit (112 B) | 1.9560 us/op | 1.3520 us/op | 1.45 |
| copy serialized SignedVoluntaryExit (112 B) | 1.4680 us/op | 1.2130 us/op | 1.21 |
| transfer serialized ProposerSlashing (416 B) | 2.6930 us/op | 2.4070 us/op | 1.12 |
| copy serialized ProposerSlashing (416 B) | 2.5690 us/op | 2.4290 us/op | 1.06 |
| transfer serialized Attestation (485 B) | 2.9620 us/op | 2.6740 us/op | 1.11 |
| copy serialized Attestation (485 B) | 2.5120 us/op | 2.5130 us/op | 1.00 |
| transfer serialized AttesterSlashing (33232 B) | 2.8630 us/op | 2.1870 us/op | 1.31 |
| copy serialized AttesterSlashing (33232 B) | 7.2440 us/op | 5.5640 us/op | 1.30 |
| transfer serialized Small SignedBeaconBlock (128000 B) | 3.1720 us/op | 2.5050 us/op | 1.27 |
| copy serialized Small SignedBeaconBlock (128000 B) | 17.406 us/op | 12.381 us/op | 1.41 |
| transfer serialized Avg SignedBeaconBlock (200000 B) | 3.2220 us/op | 1.9180 us/op | 1.68 |
| copy serialized Avg SignedBeaconBlock (200000 B) | 28.965 us/op | 18.075 us/op | 1.60 |
| transfer serialized BlobsSidecar (524380 B) | 3.6820 us/op | 2.1940 us/op | 1.68 |
| copy serialized BlobsSidecar (524380 B) | 102.34 us/op | 88.852 us/op | 1.15 |
| transfer serialized Big SignedBeaconBlock (1000000 B) | 3.7160 us/op | 2.5240 us/op | 1.47 |
| copy serialized Big SignedBeaconBlock (1000000 B) | 213.50 us/op | 159.43 us/op | 1.34 |
| pass gossip attestations to forkchoice per slot | 4.1542 ms/op | 2.5256 ms/op | 1.64 |
| forkChoice updateHead vc 100000 bc 64 eq 0 | 716.82 us/op | 408.54 us/op | 1.75 |
| forkChoice updateHead vc 600000 bc 64 eq 0 | 6.9680 ms/op | 3.5784 ms/op | 1.95 |
| forkChoice updateHead vc 1000000 bc 64 eq 0 | 8.1563 ms/op | 4.4116 ms/op | 1.85 |
| forkChoice updateHead vc 600000 bc 320 eq 0 | 4.4006 ms/op | 2.5246 ms/op | 1.74 |
| forkChoice updateHead vc 600000 bc 1200 eq 0 | 4.4421 ms/op | 2.6956 ms/op | 1.65 |
| forkChoice updateHead vc 600000 bc 7200 eq 0 | 5.8296 ms/op | 3.3738 ms/op | 1.73 |
| forkChoice updateHead vc 600000 bc 64 eq 1000 | 11.486 ms/op | 9.5209 ms/op | 1.21 |
| forkChoice updateHead vc 600000 bc 64 eq 10000 | 12.691 ms/op | 9.4277 ms/op | 1.35 |
| forkChoice updateHead vc 600000 bc 64 eq 300000 | 16.737 ms/op | 12.048 ms/op | 1.39 |
| computeDeltas 500000 validators 300 proto nodes | 6.9287 ms/op | 3.0342 ms/op | 2.28 |
| computeDeltas 500000 validators 1200 proto nodes | 6.9815 ms/op | 2.9844 ms/op | 2.34 |
| computeDeltas 500000 validators 7200 proto nodes | 6.5272 ms/op | 3.0288 ms/op | 2.16 |
| computeDeltas 750000 validators 300 proto nodes | 9.7857 ms/op | 4.5354 ms/op | 2.16 |
| computeDeltas 750000 validators 1200 proto nodes | 10.123 ms/op | 4.6162 ms/op | 2.19 |
| computeDeltas 750000 validators 7200 proto nodes | 10.068 ms/op | 4.6233 ms/op | 2.18 |
| computeDeltas 1400000 validators 300 proto nodes | 18.707 ms/op | 9.0161 ms/op | 2.07 |
| computeDeltas 1400000 validators 1200 proto nodes | 19.043 ms/op | 8.8822 ms/op | 2.14 |
| computeDeltas 1400000 validators 7200 proto nodes | 19.206 ms/op | 8.9826 ms/op | 2.14 |
| computeDeltas 2100000 validators 300 proto nodes | 28.992 ms/op | 12.937 ms/op | 2.24 |
| computeDeltas 2100000 validators 1200 proto nodes | 29.317 ms/op | 13.041 ms/op | 2.25 |
| computeDeltas 2100000 validators 7200 proto nodes | 27.893 ms/op | 12.918 ms/op | 2.16 |
| altair processAttestation - 250000 vs - 7PWei normalcase | 2.7288 ms/op | 1.5009 ms/op | 1.82 |
| altair processAttestation - 250000 vs - 7PWei worstcase | 3.7090 ms/op | 2.2197 ms/op | 1.67 |
| altair processAttestation - setStatus - 1/6 committees join | 187.16 us/op | 74.590 us/op | 2.51 |
| altair processAttestation - setStatus - 1/3 committees join | 351.17 us/op | 141.54 us/op | 2.48 |
| altair processAttestation - setStatus - 1/2 committees join | 493.31 us/op | 207.75 us/op | 2.37 |
| altair processAttestation - setStatus - 2/3 committees join | 621.24 us/op | 283.65 us/op | 2.19 |
| altair processAttestation - setStatus - 4/5 committees join | 830.84 us/op | 397.04 us/op | 2.09 |
| altair processAttestation - setStatus - 100% committees join | 986.21 us/op | 495.81 us/op | 1.99 |
| altair processBlock - 250000 vs - 7PWei normalcase | 8.0078 ms/op | 6.4040 ms/op | 1.25 |
| altair processBlock - 250000 vs - 7PWei normalcase hashState | 32.068 ms/op | 29.608 ms/op | 1.08 |
| altair processBlock - 250000 vs - 7PWei worstcase | 40.104 ms/op | 34.108 ms/op | 1.18 |
| altair processBlock - 250000 vs - 7PWei worstcase hashState | 92.888 ms/op | 87.778 ms/op | 1.06 |
| phase0 processBlock - 250000 vs - 7PWei normalcase | 2.4058 ms/op | 1.9850 ms/op | 1.21 |
| phase0 processBlock - 250000 vs - 7PWei worstcase | 33.582 ms/op | 24.777 ms/op | 1.36 |
| altair processEth1Data - 250000 vs - 7PWei normalcase | 519.34 us/op | 266.64 us/op | 1.95 |
| getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15 | 9.5740 us/op | 6.8070 us/op | 1.41 |
| getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219 | 70.483 us/op | 62.116 us/op | 1.13 |
| getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42 | 18.212 us/op | 9.1430 us/op | 1.99 |
| getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18 | 14.014 us/op | 13.503 us/op | 1.04 |
| getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020 | 200.62 us/op | 152.52 us/op | 1.32 |
| getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777 | 1.3085 ms/op | 1.1049 ms/op | 1.18 |
| getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384 | 1.7877 ms/op | 1.4843 ms/op | 1.20 |
| getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384 | 1.7391 ms/op | 980.63 us/op | 1.77 |
| getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384 | 3.6838 ms/op | 2.2277 ms/op | 1.65 |
| getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384 | 2.5666 ms/op | 1.3811 ms/op | 1.86 |
| getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384 | 5.2419 ms/op | 3.3888 ms/op | 1.55 |
| Tree 40 250000 create | 399.05 ms/op | 275.48 ms/op | 1.45 |
| Tree 40 250000 get(125000) | 208.79 ns/op | 116.77 ns/op | 1.79 |
| Tree 40 250000 set(125000) | 1.0965 us/op | 748.87 ns/op | 1.46 |
| Tree 40 250000 toArray() | 22.981 ms/op | 9.6392 ms/op | 2.38 |
| Tree 40 250000 iterate all - toArray() + loop | 21.865 ms/op | 9.7428 ms/op | 2.24 |
| Tree 40 250000 iterate all - get(i) | 69.253 ms/op | 39.950 ms/op | 1.73 |
| MutableVector 250000 create | 12.361 ms/op | 11.104 ms/op | 1.11 |
| MutableVector 250000 get(125000) | 6.4640 ns/op | 5.5590 ns/op | 1.16 |
| MutableVector 250000 set(125000) | 277.69 ns/op | 199.63 ns/op | 1.39 |
| MutableVector 250000 toArray() | 3.6499 ms/op | 2.1733 ms/op | 1.68 |
| MutableVector 250000 iterate all - toArray() + loop | 3.6843 ms/op | 2.4001 ms/op | 1.54 |
| MutableVector 250000 iterate all - get(i) | 1.5419 ms/op | 1.3419 ms/op | 1.15 |
| Array 250000 create | 3.2785 ms/op | 2.0266 ms/op | 1.62 |
| Array 250000 clone - spread | 1.3667 ms/op | 1.0892 ms/op | 1.25 |
| Array 250000 get(125000) | 1.1470 ns/op | 1.0070 ns/op | 1.14 |
| Array 250000 set(125000) | 4.4760 ns/op | 1.2130 ns/op | 3.69 |
| Array 250000 iterate all - loop | 170.91 us/op | 153.01 us/op | 1.12 |
| effectiveBalanceIncrements clone Uint8Array 300000 | 37.390 us/op | 13.785 us/op | 2.71 |
| effectiveBalanceIncrements clone MutableVector 300000 | 428.00 ns/op | 396.00 ns/op | 1.08 |
| effectiveBalanceIncrements rw all Uint8Array 300000 | 203.88 us/op | 183.05 us/op | 1.11 |
| effectiveBalanceIncrements rw all MutableVector 300000 | 102.47 ms/op | 62.669 ms/op | 1.64 |
| phase0 afterProcessEpoch - 250000 vs - 7PWei | 117.57 ms/op | 76.949 ms/op | 1.53 |
| phase0 beforeProcessEpoch - 250000 vs - 7PWei | 51.424 ms/op | 41.843 ms/op | 1.23 |
| altair processEpoch - mainnet_e81889 | 478.32 ms/op | 410.39 ms/op | 1.17 |
| mainnet_e81889 - altair beforeProcessEpoch | 89.858 ms/op | 70.880 ms/op | 1.27 |
| mainnet_e81889 - altair processJustificationAndFinalization | 12.809 us/op | 10.954 us/op | 1.17 |
| mainnet_e81889 - altair processInactivityUpdates | 6.1893 ms/op | 4.0060 ms/op | 1.54 |
| mainnet_e81889 - altair processRewardsAndPenalties | 74.538 ms/op | 63.589 ms/op | 1.17 |
| mainnet_e81889 - altair processRegistryUpdates | 2.5460 us/op | 1.4360 us/op | 1.77 |
| mainnet_e81889 - altair processSlashings | 573.00 ns/op | 558.00 ns/op | 1.03 |
| mainnet_e81889 - altair processEth1DataReset | 549.00 ns/op | 553.00 ns/op | 0.99 |
| mainnet_e81889 - altair processEffectiveBalanceUpdates | 1.3759 ms/op | 1.7249 ms/op | 0.80 |
| mainnet_e81889 - altair processSlashingsReset | 5.8280 us/op | 2.6180 us/op | 2.23 |
| mainnet_e81889 - altair processRandaoMixesReset | 4.5450 us/op | 3.4280 us/op | 1.33 |
| mainnet_e81889 - altair processHistoricalRootsUpdate | 781.00 ns/op | 1.2550 us/op | 0.62 |
| mainnet_e81889 - altair processParticipationFlagUpdates | 1.5640 us/op | 2.5490 us/op | 0.61 |
| mainnet_e81889 - altair processSyncCommitteeUpdates | 952.00 ns/op | 745.00 ns/op | 1.28 |
| mainnet_e81889 - altair afterProcessEpoch | 119.62 ms/op | 80.593 ms/op | 1.48 |
| capella processEpoch - mainnet_e217614 | 2.1029 s/op | 1.6533 s/op | 1.27 |
| mainnet_e217614 - capella beforeProcessEpoch | 487.18 ms/op | 406.70 ms/op | 1.20 |
| mainnet_e217614 - capella processJustificationAndFinalization | 16.002 us/op | 11.529 us/op | 1.39 |
| mainnet_e217614 - capella processInactivityUpdates | 19.647 ms/op | 20.048 ms/op | 0.98 |
| mainnet_e217614 - capella processRewardsAndPenalties | 559.52 ms/op | 482.40 ms/op | 1.16 |
| mainnet_e217614 - capella processRegistryUpdates | 22.189 us/op | 20.768 us/op | 1.07 |
| mainnet_e217614 - capella processSlashings | 553.00 ns/op | 650.00 ns/op | 0.85 |
| mainnet_e217614 - capella processEth1DataReset | 446.00 ns/op | 620.00 ns/op | 0.72 |
| mainnet_e217614 - capella processEffectiveBalanceUpdates | 4.5526 ms/op | 3.4340 ms/op | 1.33 |
| mainnet_e217614 - capella processSlashingsReset | 2.5420 us/op | 2.9250 us/op | 0.87 |
| mainnet_e217614 - capella processRandaoMixesReset | 4.0010 us/op | 4.4160 us/op | 0.91 |
| mainnet_e217614 - capella processHistoricalRootsUpdate | 643.00 ns/op | 939.00 ns/op | 0.68 |
| mainnet_e217614 - capella processParticipationFlagUpdates | 1.7890 us/op | 1.2180 us/op | 1.47 |
| mainnet_e217614 - capella afterProcessEpoch | 336.04 ms/op | 233.20 ms/op | 1.44 |
| phase0 processEpoch - mainnet_e58758 | 434.32 ms/op | 436.46 ms/op | 1.00 |
| mainnet_e58758 - phase0 beforeProcessEpoch | 134.84 ms/op | 131.36 ms/op | 1.03 |
| mainnet_e58758 - phase0 processJustificationAndFinalization | 15.793 us/op | 13.773 us/op | 1.15 |
| mainnet_e58758 - phase0 processRewardsAndPenalties | 55.352 ms/op | 56.785 ms/op | 0.97 |
| mainnet_e58758 - phase0 processRegistryUpdates | 11.390 us/op | 17.106 us/op | 0.67 |
| mainnet_e58758 - phase0 processSlashings | 573.00 ns/op | 887.00 ns/op | 0.65 |
| mainnet_e58758 - phase0 processEth1DataReset | 418.00 ns/op | 1.0370 us/op | 0.40 |
| mainnet_e58758 - phase0 processEffectiveBalanceUpdates | 1.1169 ms/op | 852.22 us/op | 1.31 |
| mainnet_e58758 - phase0 processSlashingsReset | 2.4100 us/op | 3.1920 us/op | 0.76 |
| mainnet_e58758 - phase0 processRandaoMixesReset | 3.7820 us/op | 4.4010 us/op | 0.86 |
| mainnet_e58758 - phase0 processHistoricalRootsUpdate | 457.00 ns/op | 690.00 ns/op | 0.66 |
| mainnet_e58758 - phase0 processParticipationRecordUpdates | 3.1270 us/op | 5.1800 us/op | 0.60 |
| mainnet_e58758 - phase0 afterProcessEpoch | 104.72 ms/op | 71.587 ms/op | 1.46 |
| phase0 processEffectiveBalanceUpdates - 250000 normalcase | 1.3453 ms/op | 1.2401 ms/op | 1.08 |
| phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 | 1.4439 ms/op | 1.1358 ms/op | 1.27 |
| altair processInactivityUpdates - 250000 normalcase | 23.961 ms/op | 22.137 ms/op | 1.08 |
| altair processInactivityUpdates - 250000 worstcase | 24.964 ms/op | 25.006 ms/op | 1.00 |
| phase0 processRegistryUpdates - 250000 normalcase | 10.624 us/op | 6.6780 us/op | 1.59 |
| phase0 processRegistryUpdates - 250000 badcase_full_deposits | 380.25 us/op | 417.22 us/op | 0.91 |
| phase0 processRegistryUpdates - 250000 worstcase 0.5 | 136.26 ms/op | 107.16 ms/op | 1.27 |
| altair processRewardsAndPenalties - 250000 normalcase | 72.759 ms/op | 71.250 ms/op | 1.02 |
| altair processRewardsAndPenalties - 250000 worstcase | 69.606 ms/op | 68.697 ms/op | 1.01 |
| phase0 getAttestationDeltas - 250000 normalcase | 12.197 ms/op | 5.7930 ms/op | 2.11 |
| phase0 getAttestationDeltas - 250000 worstcase | 12.637 ms/op | 6.3040 ms/op | 2.00 |
| phase0 processSlashings - 250000 worstcase | 115.22 us/op | 88.175 us/op | 1.31 |
| altair processSyncCommitteeUpdates - 250000 | 160.97 ms/op | 114.03 ms/op | 1.41 |
| BeaconState.hashTreeRoot - No change | 493.00 ns/op | 353.00 ns/op | 1.40 |
| BeaconState.hashTreeRoot - 1 full validator | 127.36 us/op | 125.66 us/op | 1.01 |
| BeaconState.hashTreeRoot - 32 full validator | 1.3215 ms/op | 1.4299 ms/op | 0.92 |
| BeaconState.hashTreeRoot - 512 full validator | 14.647 ms/op | 13.356 ms/op | 1.10 |
| BeaconState.hashTreeRoot - 1 validator.effectiveBalance | 148.97 us/op | 133.95 us/op | 1.11 |
| BeaconState.hashTreeRoot - 32 validator.effectiveBalance | 2.1419 ms/op | 2.2800 ms/op | 0.94 |
| BeaconState.hashTreeRoot - 512 validator.effectiveBalance | 25.644 ms/op | 28.912 ms/op | 0.89 |
| BeaconState.hashTreeRoot - 1 balances | 118.92 us/op | 111.67 us/op | 1.06 |
| BeaconState.hashTreeRoot - 32 balances | 1.0670 ms/op | 976.40 us/op | 1.09 |
| BeaconState.hashTreeRoot - 512 balances | 10.885 ms/op | 9.6161 ms/op | 1.13 |
| BeaconState.hashTreeRoot - 250000 balances | 192.02 ms/op | 185.73 ms/op | 1.03 |
| aggregationBits - 2048 els - zipIndexesInBitList | 30.309 us/op | 20.392 us/op | 1.49 |
| byteArrayEquals 32 | 79.011 ns/op | 64.624 ns/op | 1.22 |
| Buffer.compare 32 | 55.715 ns/op | 36.037 ns/op | 1.55 |
| byteArrayEquals 1024 | 2.0667 us/op | 1.6319 us/op | 1.27 |
| Buffer.compare 1024 | 71.055 ns/op | 40.993 ns/op | 1.73 |
| byteArrayEquals 16384 | 33.037 us/op | 25.977 us/op | 1.27 |
| Buffer.compare 16384 | 280.83 ns/op | 216.31 ns/op | 1.30 |
| byteArrayEquals 123687377 | 251.50 ms/op | 193.01 ms/op | 1.30 |
| Buffer.compare 123687377 | 7.5153 ms/op | 5.3504 ms/op | 1.40 |
| byteArrayEquals 32 - diff last byte | 76.788 ns/op | 60.101 ns/op | 1.28 |
| Buffer.compare 32 - diff last byte | 59.524 ns/op | 35.714 ns/op | 1.67 |
| byteArrayEquals 1024 - diff last byte | 2.0441 us/op | 1.6537 us/op | 1.24 |
| Buffer.compare 1024 - diff last byte | 72.354 ns/op | 42.057 ns/op | 1.72 |
| byteArrayEquals 16384 - diff last byte | 32.812 us/op | 25.977 us/op | 1.26 |
| Buffer.compare 16384 - diff last byte | 257.97 ns/op | 194.82 ns/op | 1.32 |
| byteArrayEquals 123687377 - diff last byte | 250.58 ms/op | 197.44 ms/op | 1.27 |
| Buffer.compare 123687377 - diff last byte | 7.3292 ms/op | 5.3423 ms/op | 1.37 |
| byteArrayEquals 32 - random bytes | 5.4840 ns/op | 4.3600 ns/op | 1.26 |
| Buffer.compare 32 - random bytes | 62.472 ns/op | 37.463 ns/op | 1.67 |
| byteArrayEquals 1024 - random bytes | 5.5040 ns/op | 4.3160 ns/op | 1.28 |
| Buffer.compare 1024 - random bytes | 62.086 ns/op | 35.481 ns/op | 1.75 |
| byteArrayEquals 16384 - random bytes | 5.4430 ns/op | 4.3150 ns/op | 1.26 |
| Buffer.compare 16384 - random bytes | 61.149 ns/op | 35.501 ns/op | 1.72 |
| byteArrayEquals 123687377 - random bytes | 8.7500 ns/op | 7.7000 ns/op | 1.14 |
| Buffer.compare 123687377 - random bytes | 64.940 ns/op | 37.920 ns/op | 1.71 |
| regular array get 100000 times | 47.142 us/op | 39.562 us/op | 1.19 |
| wrappedArray get 100000 times | 46.293 us/op | 39.536 us/op | 1.17 |
| arrayWithProxy get 100000 times | 14.879 ms/op | 9.2001 ms/op | 1.62 |
| ssz.Root.equals | 55.097 ns/op | 53.856 ns/op | 1.02 |
| byteArrayEquals | 55.360 ns/op | 52.910 ns/op | 1.05 |
| Buffer.compare | 11.446 ns/op | 8.7930 ns/op | 1.30 |
| shuffle list - 16384 els | 8.7324 ms/op | 5.7431 ms/op | 1.52 |
| shuffle list - 250000 els | 129.11 ms/op | 85.682 ms/op | 1.51 |
| processSlot - 1 slots | 18.897 us/op | 13.511 us/op | 1.40 |
| processSlot - 32 slots | 3.0363 ms/op | 3.2630 ms/op | 0.93 |
| getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei | 59.526 ms/op | 54.166 ms/op | 1.10 |
| getCommitteeAssignments - req 1 vs - 250000 vc | 2.7550 ms/op | 2.3818 ms/op | 1.16 |
| getCommitteeAssignments - req 100 vs - 250000 vc | 3.9738 ms/op | 3.5242 ms/op | 1.13 |
| getCommitteeAssignments - req 1000 vs - 250000 vc | 4.3799 ms/op | 3.7798 ms/op | 1.16 |
| findModifiedValidators - 10000 modified validators | 363.88 ms/op | 298.56 ms/op | 1.22 |
| findModifiedValidators - 1000 modified validators | 211.57 ms/op | 169.64 ms/op | 1.25 |
| findModifiedValidators - 100 modified validators | 187.52 ms/op | 135.48 ms/op | 1.38 |
| findModifiedValidators - 10 modified validators | 179.48 ms/op | 125.17 ms/op | 1.43 |
| findModifiedValidators - 1 modified validators | 184.20 ms/op | 129.09 ms/op | 1.43 |
| findModifiedValidators - no difference | 190.35 ms/op | 151.01 ms/op | 1.26 |
| compare ViewDUs | 4.5126 s/op | 3.8810 s/op | 1.16 |
| compare each validator Uint8Array | 1.5994 s/op | 1.6272 s/op | 0.98 |
| compare ViewDU to Uint8Array | 1.2820 s/op | 870.08 ms/op | 1.47 |
| migrate state 1000000 validators, 24 modified, 0 new | 714.04 ms/op | 729.48 ms/op | 0.98 |
| migrate state 1000000 validators, 1700 modified, 1000 new | 1.0406 s/op | 992.97 ms/op | 1.05 |
| migrate state 1000000 validators, 3400 modified, 2000 new | 1.2716 s/op | 1.0512 s/op | 1.21 |
| migrate state 1500000 validators, 24 modified, 0 new | 775.32 ms/op | 755.64 ms/op | 1.03 |
| migrate state 1500000 validators, 1700 modified, 1000 new | 1.0097 s/op | 962.97 ms/op | 1.05 |
| migrate state 1500000 validators, 3400 modified, 2000 new | 1.3166 s/op | 1.2063 s/op | 1.09 |
| RootCache.getBlockRootAtSlot - 250000 vs - 7PWei | 4.8100 ns/op | 5.3100 ns/op | 0.91 |
| state getBlockRootAtSlot - 250000 vs - 7PWei | 855.54 ns/op | 1.0902 us/op | 0.78 |
| computeProposers - vc 250000 | 10.760 ms/op | 7.3855 ms/op | 1.46 |
| computeEpochShuffling - vc 250000 | 130.72 ms/op | 94.826 ms/op | 1.38 |
| getNextSyncCommittee - vc 250000 | 154.37 ms/op | 112.02 ms/op | 1.38 |
| computeSigningRoot for AttestationData | 28.200 us/op | 19.211 us/op | 1.47 |
| hash AttestationData serialized data then Buffer.toString(base64) | 2.3921 us/op | 1.2738 us/op | 1.88 |
| toHexString serialized data | 1.1271 us/op | 769.46 ns/op | 1.46 |
| Buffer.toString(base64) | 257.72 ns/op | 143.26 ns/op | 1.80 |
by benchmarkbot/action
Codecov Report
Additional details and impacted files@@ Coverage Diff @@
## unstable #6618 +/- ##
=========================================
Coverage 61.61% 61.61%
=========================================
Files 556 556
Lines 58567 58567
Branches 1859 1859
=========================================
Hits 36084 36084
Misses 22442 22442
Partials 41 41 |
|
🎉 This PR is included in v1.18.0 🎉 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Motivation
The checkpoint state cache labels are duplicate
Description
Add
{{type}}to labels