Tracker: Improve Lodestar error UX

[g11tech]

This is a tracker to collect all issues regarding to improving lodestar error UX. Most of the times we are pretty aggressive in throwing error even if its intermittent/self resolvable and requires no user action/attention.

For such issues, an error accumulator should be used and only throw if accumulator exceeds threshold (accum resets and starts from 0 if the progress is made between consecutive tries)

Issues:

• Block Parent Unknown Chain logs "expected" errors #3062 (comment) as raised here Chain logs "expected" errors #3062 and Support mev-boost in lodestar flashbots/mev-boost#157
• Improve jsonRPC error UX for eth1 + execution #4348
• Epoch cache error should be treated with care in gossips validation #5938
• Not able to validate attestation: Requesting slot committee out of range #4396
• Make logs less scary #4146
• Investigate possible EventEmitter memory leak #3569
• Suppress non-harmful error logs of the backfill sync #3605
• Better error reporting on bad enr in --bootnodes #4522
• Node notifier error headState does not exist #4523
• Revisit state transition errors / error messages #2311
• Better logging for exit-validator if key is not yet activated on beacon chain #4540
• Annoying error stacks in logs #4559

[dapplion]

Also this one, reported by Micah

Aug-11 07:37:06.001[]                 info: Synced - slot: 3641285 (skipped 2) - head: 3641283 0xfbcb…edb2 - execution: syncing(0x0631…0396) - finalized: 0xb07e…a3e6:113787 - peers: 47
Aug-11 07:37:18.000[]                 info: Synced - slot: 3641286 - head: 3641286 0x20b6…cf2a - execution: syncing(0xe143…c4d6) - finalized: 0xb07e…a3e6:113787 - peers: 47
Aug-11 07:37:24.112[NETWORK]         error: Gossip validation beacon_aggregate_and_proof threw a non-GossipActionError  Requesting slot committee out of range epoch: 113790 current: 113788
Error: Requesting slot committee out of range epoch: 113790 current: 113788
    at EpochContext.getShufflingAtEpoch (file:///usr/app/node_modules/@lodestar/state-transition/src/cache/epochContext.ts:669:13)
    at EpochContext.getShufflingAtSlot (file:///usr/app/node_modules/@lodestar/state-transition/src/cache/epochContext.ts:658:17)

[philknows]

Also tagging #4396, #4146 in here

[philknows]

#3569

EDIT (by @dapplion ) added all of these above in the main body

[nazarhussain]

All the tasks mentioned for this epic is closed.