Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

chore: update dashboards to support network worker #5593

Merged
merged 1 commit into from
May 31, 2023
Merged

chore: update dashboards to support network worker #5593

merged 1 commit into from
May 31, 2023

Conversation

dapplion
Copy link
Contributor

@dapplion dapplion commented May 31, 2023 •
edited
Loading

Motivation

Update dashboards to support network worker

Description

Add worker's metrics to VM dashboard

image
image

Add late response rate in ReqResp

image

@dapplion dapplion requested a review from a team as a code owner May 31, 2023 09:57
@github-actions
Copy link
Contributor

Performance Report

✔️ no performance regression detected

Full benchmark results
Benchmark suite Current: 822d4a8 Previous: 951fda6 Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 601.37 us/op 584.72 us/op 1.03
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 57.852 us/op 52.460 us/op 1.10
BLS verify - blst-native 1.2842 ms/op 1.2319 ms/op 1.04
BLS verifyMultipleSignatures 3 - blst-native 2.6153 ms/op 2.5107 ms/op 1.04
BLS verifyMultipleSignatures 8 - blst-native 5.6088 ms/op 5.4157 ms/op 1.04
BLS verifyMultipleSignatures 32 - blst-native 20.292 ms/op 19.974 ms/op 1.02
BLS aggregatePubkeys 32 - blst-native 27.264 us/op 26.921 us/op 1.01
BLS aggregatePubkeys 128 - blst-native 105.69 us/op 104.47 us/op 1.01
getAttestationsForBlock 72.270 ms/op 63.777 ms/op 1.13
isKnown best case - 1 super set check 268.00 ns/op 265.00 ns/op 1.01
isKnown normal case - 2 super set checks 259.00 ns/op 257.00 ns/op 1.01
isKnown worse case - 16 super set checks 260.00 ns/op 252.00 ns/op 1.03
CheckpointStateCache - add get delete 6.1230 us/op 5.7070 us/op 1.07
validate gossip signedAggregateAndProof - struct 2.9137 ms/op 2.8365 ms/op 1.03
validate gossip attestation - struct 1.3646 ms/op 1.3348 ms/op 1.02
pickEth1Vote - no votes 1.4557 ms/op 1.3773 ms/op 1.06
pickEth1Vote - max votes 12.737 ms/op 14.177 ms/op 0.90
pickEth1Vote - Eth1Data hashTreeRoot value x2048 9.8522 ms/op 9.9159 ms/op 0.99
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 19.651 ms/op 14.493 ms/op 1.36
pickEth1Vote - Eth1Data fastSerialize value x2048 831.17 us/op 646.03 us/op 1.29
pickEth1Vote - Eth1Data fastSerialize tree x2048 7.3616 ms/op 9.2358 ms/op 0.80
bytes32 toHexString 860.00 ns/op 751.00 ns/op 1.15
bytes32 Buffer.toString(hex) 461.00 ns/op 452.00 ns/op 1.02
bytes32 Buffer.toString(hex) from Uint8Array 650.00 ns/op 653.00 ns/op 1.00
bytes32 Buffer.toString(hex) + 0x 468.00 ns/op 464.00 ns/op 1.01
Object access 1 prop 0.21500 ns/op 0.21600 ns/op 1.00
Map access 1 prop 0.17200 ns/op 0.16900 ns/op 1.02
Object get x1000 6.9340 ns/op 6.8690 ns/op 1.01
Map get x1000 0.63600 ns/op 0.68100 ns/op 0.93
Object set x1000 73.046 ns/op 69.595 ns/op 1.05
Map set x1000 60.791 ns/op 60.748 ns/op 1.00
Return object 10000 times 0.25890 ns/op 0.29680 ns/op 0.87
Throw Error 10000 times 4.4942 us/op 4.5989 us/op 0.98
fastMsgIdFn sha256 / 200 bytes 3.7190 us/op 3.7290 us/op 1.00
fastMsgIdFn h32 xxhash / 200 bytes 343.00 ns/op 340.00 ns/op 1.01
fastMsgIdFn h64 xxhash / 200 bytes 508.00 ns/op 490.00 ns/op 1.04
fastMsgIdFn sha256 / 1000 bytes 12.203 us/op 12.116 us/op 1.01
fastMsgIdFn h32 xxhash / 1000 bytes 482.00 ns/op 457.00 ns/op 1.05
fastMsgIdFn h64 xxhash / 1000 bytes 630.00 ns/op 567.00 ns/op 1.11
fastMsgIdFn sha256 / 10000 bytes 110.08 us/op 106.62 us/op 1.03
fastMsgIdFn h32 xxhash / 10000 bytes 2.1280 us/op 2.0420 us/op 1.04
fastMsgIdFn h64 xxhash / 10000 bytes 1.5680 us/op 1.4510 us/op 1.08
enrSubnets - fastDeserialize 64 bits 1.9220 us/op 1.6440 us/op 1.17
enrSubnets - ssz BitVector 64 bits 659.00 ns/op 516.00 ns/op 1.28
enrSubnets - fastDeserialize 4 bits 224.00 ns/op 173.00 ns/op 1.29
enrSubnets - ssz BitVector 4 bits 661.00 ns/op 491.00 ns/op 1.35
prioritizePeers score -10:0 att 32-0.1 sync 2-0 147.94 us/op 136.58 us/op 1.08
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 208.49 us/op 155.68 us/op 1.34
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 237.63 us/op 183.38 us/op 1.30
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 453.52 us/op 331.80 us/op 1.37
prioritizePeers score 0:0 att 64-1 sync 4-1 541.07 us/op 382.33 us/op 1.42
array of 16000 items push then shift 1.7504 us/op 1.7188 us/op 1.02
LinkedList of 16000 items push then shift 10.450 ns/op 8.9220 ns/op 1.17
array of 16000 items push then pop 140.79 ns/op 85.031 ns/op 1.66
LinkedList of 16000 items push then pop 9.5100 ns/op 8.4330 ns/op 1.13
array of 24000 items push then shift 2.4791 us/op 2.3325 us/op 1.06
LinkedList of 24000 items push then shift 9.9010 ns/op 8.5900 ns/op 1.15
array of 24000 items push then pop 95.253 ns/op 74.576 ns/op 1.28
LinkedList of 24000 items push then pop 9.3110 ns/op 8.3490 ns/op 1.12
intersect bitArray bitLen 8 13.682 ns/op 12.901 ns/op 1.06
intersect array and set length 8 88.908 ns/op 73.224 ns/op 1.21
intersect bitArray bitLen 128 45.069 ns/op 43.257 ns/op 1.04
intersect array and set length 128 1.2656 us/op 1.0229 us/op 1.24
Buffer.concat 32 items 3.0840 us/op 2.5790 us/op 1.20
Uint8Array.set 32 items 2.5900 us/op 2.4670 us/op 1.05
transfer serialized Status (84 B) 2.2130 us/op 1.9990 us/op 1.11
copy serialized Status (84 B) 1.8550 us/op 1.7560 us/op 1.06
transfer serialized SignedVoluntaryExit (112 B) 2.1620 us/op 2.1410 us/op 1.01
copy serialized SignedVoluntaryExit (112 B) 1.8420 us/op 1.7090 us/op 1.08
transfer serialized ProposerSlashing (416 B) 2.3720 us/op 2.5580 us/op 0.93
copy serialized ProposerSlashing (416 B) 2.1730 us/op 3.0540 us/op 0.71
transfer serialized Attestation (485 B) 2.3520 us/op 2.7680 us/op 0.85
copy serialized Attestation (485 B) 2.2100 us/op 2.8060 us/op 0.79
transfer serialized AttesterSlashing (33232 B) 2.4610 us/op 2.6960 us/op 0.91
copy serialized AttesterSlashing (33232 B) 5.7630 us/op 5.4400 us/op 1.06
transfer serialized Small SignedBeaconBlock (128000 B) 2.8930 us/op 2.8290 us/op 1.02
copy serialized Small SignedBeaconBlock (128000 B) 48.220 us/op 12.892 us/op 3.74
transfer serialized Avg SignedBeaconBlock (200000 B) 3.1700 us/op 3.0900 us/op 1.03
copy serialized Avg SignedBeaconBlock (200000 B) 57.960 us/op 17.648 us/op 3.28
transfer serialized BlobsSidecar (524380 B) 3.2770 us/op 3.0410 us/op 1.08
copy serialized BlobsSidecar (524380 B) 124.46 us/op 150.39 us/op 0.83
transfer serialized Big SignedBeaconBlock (1000000 B) 3.4170 us/op 3.1140 us/op 1.10
copy serialized Big SignedBeaconBlock (1000000 B) 151.26 us/op 282.04 us/op 0.54
pass gossip attestations to forkchoice per slot 2.3139 ms/op 2.2667 ms/op 1.02
computeDeltas 2.8826 ms/op 3.1679 ms/op 0.91
computeProposerBoostScoreFromBalances 1.7747 ms/op 1.7744 ms/op 1.00
altair processAttestation - 250000 vs - 7PWei normalcase 2.0735 ms/op 2.1834 ms/op 0.95
altair processAttestation - 250000 vs - 7PWei worstcase 3.1170 ms/op 3.9633 ms/op 0.79
altair processAttestation - setStatus - 1/6 committees join 138.33 us/op 144.45 us/op 0.96
altair processAttestation - setStatus - 1/3 committees join 260.44 us/op 275.41 us/op 0.95
altair processAttestation - setStatus - 1/2 committees join 365.21 us/op 372.90 us/op 0.98
altair processAttestation - setStatus - 2/3 committees join 468.62 us/op 466.19 us/op 1.01
altair processAttestation - setStatus - 4/5 committees join 647.44 us/op 653.33 us/op 0.99
altair processAttestation - setStatus - 100% committees join 725.33 us/op 765.08 us/op 0.95
altair processBlock - 250000 vs - 7PWei normalcase 19.097 ms/op 18.525 ms/op 1.03
altair processBlock - 250000 vs - 7PWei normalcase hashState 25.862 ms/op 24.721 ms/op 1.05
altair processBlock - 250000 vs - 7PWei worstcase 51.794 ms/op 50.975 ms/op 1.02
altair processBlock - 250000 vs - 7PWei worstcase hashState 69.962 ms/op 66.999 ms/op 1.04
phase0 processBlock - 250000 vs - 7PWei normalcase 1.9966 ms/op 2.0498 ms/op 0.97
phase0 processBlock - 250000 vs - 7PWei worstcase 28.087 ms/op 28.997 ms/op 0.97
altair processEth1Data - 250000 vs - 7PWei normalcase 454.23 us/op 489.74 us/op 0.93
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15 6.5370 us/op 8.6080 us/op 0.76
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219 19.366 us/op 26.108 us/op 0.74
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42 8.8450 us/op 10.827 us/op 0.82
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18 6.4860 us/op 9.4890 us/op 0.68
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020 73.775 us/op 106.73 us/op 0.69
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777 618.12 us/op 658.76 us/op 0.94
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384 894.79 us/op 911.81 us/op 0.98
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384 899.00 us/op 903.07 us/op 1.00
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384 2.2857 ms/op 2.4446 ms/op 0.94
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384 1.4542 ms/op 1.7223 ms/op 0.84
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384 3.5463 ms/op 3.9182 ms/op 0.91
Tree 40 250000 create 316.64 ms/op 313.01 ms/op 1.01
Tree 40 250000 get(125000) 178.06 ns/op 196.72 ns/op 0.91
Tree 40 250000 set(125000) 848.79 ns/op 1.0651 us/op 0.80
Tree 40 250000 toArray() 16.335 ms/op 21.322 ms/op 0.77
Tree 40 250000 iterate all - toArray() + loop 16.498 ms/op 20.879 ms/op 0.79
Tree 40 250000 iterate all - get(i) 65.764 ms/op 70.151 ms/op 0.94
MutableVector 250000 create 9.5745 ms/op 10.920 ms/op 0.88
MutableVector 250000 get(125000) 6.1530 ns/op 6.5750 ns/op 0.94
MutableVector 250000 set(125000) 251.85 ns/op 266.92 ns/op 0.94
MutableVector 250000 toArray() 2.7622 ms/op 3.2267 ms/op 0.86
MutableVector 250000 iterate all - toArray() + loop 2.8295 ms/op 3.0721 ms/op 0.92
MutableVector 250000 iterate all - get(i) 1.4639 ms/op 1.5042 ms/op 0.97
Array 250000 create 2.7453 ms/op 2.6054 ms/op 1.05
Array 250000 clone - spread 1.0768 ms/op 1.2539 ms/op 0.86
Array 250000 get(125000) 0.53400 ns/op 0.61100 ns/op 0.87
Array 250000 set(125000) 0.60200 ns/op 0.69800 ns/op 0.86
Array 250000 iterate all - loop 79.128 us/op 82.480 us/op 0.96
effectiveBalanceIncrements clone Uint8Array 300000 26.022 us/op 33.047 us/op 0.79
effectiveBalanceIncrements clone MutableVector 300000 331.00 ns/op 412.00 ns/op 0.80
effectiveBalanceIncrements rw all Uint8Array 300000 162.67 us/op 168.77 us/op 0.96
effectiveBalanceIncrements rw all MutableVector 300000 75.402 ms/op 91.607 ms/op 0.82
phase0 afterProcessEpoch - 250000 vs - 7PWei 108.34 ms/op 115.29 ms/op 0.94
phase0 beforeProcessEpoch - 250000 vs - 7PWei 40.736 ms/op 34.285 ms/op 1.19
altair processEpoch - mainnet_e81889 348.82 ms/op 318.46 ms/op 1.10
mainnet_e81889 - altair beforeProcessEpoch 67.815 ms/op 62.775 ms/op 1.08
mainnet_e81889 - altair processJustificationAndFinalization 18.004 us/op 18.205 us/op 0.99
mainnet_e81889 - altair processInactivityUpdates 5.8919 ms/op 5.9148 ms/op 1.00
mainnet_e81889 - altair processRewardsAndPenalties 70.245 ms/op 49.217 ms/op 1.43
mainnet_e81889 - altair processRegistryUpdates 2.6050 us/op 2.5750 us/op 1.01
mainnet_e81889 - altair processSlashings 625.00 ns/op 467.00 ns/op 1.34
mainnet_e81889 - altair processEth1DataReset 710.00 ns/op 544.00 ns/op 1.31
mainnet_e81889 - altair processEffectiveBalanceUpdates 1.3489 ms/op 1.2339 ms/op 1.09
mainnet_e81889 - altair processSlashingsReset 4.8960 us/op 4.7130 us/op 1.04
mainnet_e81889 - altair processRandaoMixesReset 9.7750 us/op 4.5120 us/op 2.17
mainnet_e81889 - altair processHistoricalRootsUpdate 1.1460 us/op 1.0320 us/op 1.11
mainnet_e81889 - altair processParticipationFlagUpdates 3.7100 us/op 3.2070 us/op 1.16
mainnet_e81889 - altair processSyncCommitteeUpdates 786.00 ns/op 715.00 ns/op 1.10
mainnet_e81889 - altair afterProcessEpoch 133.09 ms/op 125.24 ms/op 1.06
phase0 processEpoch - mainnet_e58758 370.96 ms/op 353.70 ms/op 1.05
mainnet_e58758 - phase0 beforeProcessEpoch 140.37 ms/op 138.16 ms/op 1.02
mainnet_e58758 - phase0 processJustificationAndFinalization 16.139 us/op 17.490 us/op 0.92
mainnet_e58758 - phase0 processRewardsAndPenalties 66.156 ms/op 59.603 ms/op 1.11
mainnet_e58758 - phase0 processRegistryUpdates 9.8730 us/op 8.1360 us/op 1.21
mainnet_e58758 - phase0 processSlashings 584.00 ns/op 539.00 ns/op 1.08
mainnet_e58758 - phase0 processEth1DataReset 556.00 ns/op 584.00 ns/op 0.95
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 1.0288 ms/op 940.76 us/op 1.09
mainnet_e58758 - phase0 processSlashingsReset 3.8200 us/op 3.4330 us/op 1.11
mainnet_e58758 - phase0 processRandaoMixesReset 4.9250 us/op 4.8940 us/op 1.01
mainnet_e58758 - phase0 processHistoricalRootsUpdate 1.1480 us/op 537.00 ns/op 2.14
mainnet_e58758 - phase0 processParticipationRecordUpdates 7.0800 us/op 3.9870 us/op 1.78
mainnet_e58758 - phase0 afterProcessEpoch 101.86 ms/op 94.833 ms/op 1.07
phase0 processEffectiveBalanceUpdates - 250000 normalcase 1.2710 ms/op 1.2114 ms/op 1.05
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 1.6516 ms/op 1.4933 ms/op 1.11
altair processInactivityUpdates - 250000 normalcase 24.911 ms/op 25.899 ms/op 0.96
altair processInactivityUpdates - 250000 worstcase 19.551 ms/op 26.572 ms/op 0.74
phase0 processRegistryUpdates - 250000 normalcase 6.8530 us/op 6.1910 us/op 1.11
phase0 processRegistryUpdates - 250000 badcase_full_deposits 269.75 us/op 249.79 us/op 1.08
phase0 processRegistryUpdates - 250000 worstcase 0.5 134.99 ms/op 127.30 ms/op 1.06
altair processRewardsAndPenalties - 250000 normalcase 69.139 ms/op 69.044 ms/op 1.00
altair processRewardsAndPenalties - 250000 worstcase 72.131 ms/op 68.849 ms/op 1.05
phase0 getAttestationDeltas - 250000 normalcase 7.3240 ms/op 6.6837 ms/op 1.10
phase0 getAttestationDeltas - 250000 worstcase 7.2249 ms/op 6.6202 ms/op 1.09
phase0 processSlashings - 250000 worstcase 3.4378 ms/op 3.6709 ms/op 0.94
altair processSyncCommitteeUpdates - 250000 178.82 ms/op 177.81 ms/op 1.01
BeaconState.hashTreeRoot - No change 281.00 ns/op 333.00 ns/op 0.84
BeaconState.hashTreeRoot - 1 full validator 54.204 us/op 52.475 us/op 1.03
BeaconState.hashTreeRoot - 32 full validator 529.95 us/op 548.39 us/op 0.97
BeaconState.hashTreeRoot - 512 full validator 5.6600 ms/op 5.3164 ms/op 1.06
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 62.372 us/op 61.077 us/op 1.02
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 935.20 us/op 883.81 us/op 1.06
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 11.716 ms/op 11.379 ms/op 1.03
BeaconState.hashTreeRoot - 1 balances 47.976 us/op 48.446 us/op 0.99
BeaconState.hashTreeRoot - 32 balances 459.30 us/op 490.16 us/op 0.94
BeaconState.hashTreeRoot - 512 balances 4.2949 ms/op 4.4740 ms/op 0.96
BeaconState.hashTreeRoot - 250000 balances 73.125 ms/op 76.532 ms/op 0.96
aggregationBits - 2048 els - zipIndexesInBitList 15.085 us/op 16.183 us/op 0.93
regular array get 100000 times 34.141 us/op 33.117 us/op 1.03
wrappedArray get 100000 times 32.531 us/op 33.231 us/op 0.98
arrayWithProxy get 100000 times 16.357 ms/op 16.120 ms/op 1.01
ssz.Root.equals 533.00 ns/op 559.00 ns/op 0.95
byteArrayEquals 528.00 ns/op 548.00 ns/op 0.96
shuffle list - 16384 els 6.6539 ms/op 6.8167 ms/op 0.98
shuffle list - 250000 els 97.360 ms/op 101.09 ms/op 0.96
processSlot - 1 slots 8.3960 us/op 8.8300 us/op 0.95
processSlot - 32 slots 1.3132 ms/op 1.3560 ms/op 0.97
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 37.297 ms/op 37.458 ms/op 1.00
getCommitteeAssignments - req 1 vs - 250000 vc 2.8876 ms/op 2.9299 ms/op 0.99
getCommitteeAssignments - req 100 vs - 250000 vc 4.1499 ms/op 4.1584 ms/op 1.00
getCommitteeAssignments - req 1000 vs - 250000 vc 4.4573 ms/op 4.5138 ms/op 0.99
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 4.3800 ns/op 4.8700 ns/op 0.90
state getBlockRootAtSlot - 250000 vs - 7PWei 885.69 ns/op 897.73 ns/op 0.99
computeProposers - vc 250000 10.062 ms/op 10.981 ms/op 0.92
computeEpochShuffling - vc 250000 98.065 ms/op 103.95 ms/op 0.94
getNextSyncCommittee - vc 250000 168.61 ms/op 177.93 ms/op 0.95
computeSigningRoot for AttestationData 12.872 us/op 14.110 us/op 0.91
hash AttestationData serialized data then Buffer.toString(base64) 2.4404 us/op 2.4643 us/op 0.99
toHexString serialized data 1.0733 us/op 1.0724 us/op 1.00
Buffer.toString(base64) 334.23 ns/op 345.82 ns/op 0.97

by benchmarkbot/action

@wemeetagain wemeetagain merged commit 3d77bfe into unstable May 31, 2023
@wemeetagain wemeetagain deleted the dapplion/dashboards-network-worker branch May 31, 2023 15:51
@wemeetagain
Copy link
Member

🎉 This PR is included in v1.9.0 🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@wemeetagain wemeetagain wemeetagain approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@dapplion @wemeetagain