Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Banking tracer with simulator wip #2

Draft
wants to merge 140 commits into
base: banking-tracer
Choose a base branch
from
Draft

Banking tracer with simulator wip #2

wants to merge 140 commits into from

Conversation

ryoqun
Copy link
Owner

@ryoqun ryoqun commented Dec 15, 2022 •
edited
Loading

this is wip pr/branch just to be shared quickly, not intended for code-reviews (even including casual ones!); built on solana-labs#29196

Problem

this kinda work...: i.e reference vs simulation kinda exhibit similar throughput and each simulations are quite similar in numbers. the first bank's hash is even identical. lol

reference

https://explorer.solana.com/block/167249284?cluster=testnet
https://explorer.solana.com/block/167249285?cluster=testnet
https://explorer.solana.com/block/167249286?cluster=testnet
https://explorer.solana.com/block/167249287?cluster=testnet

[2022-12-15T02:11:33.464713632Z INFO  solana_runtime::bank] bank frozen: 167249284 hash: HmeLnLAeaF5zjLcLr5xBqxCLZbf11Gi2kcG1phVhJW22 accounts_delta: 3FuA3ZfLYy3uNp4WHEspKftVBaTVJs7QRoKBb8mEHnWT signature_count: 3898 last_blockhash: 84HMxHV6W4o6BvJh455Zk6Yg2aU1K2TDBFpTvxuEuYG4 capitalization: 1568506868593515138
[2022-12-15T02:11:33.834317178Z INFO  solana_runtime::bank] bank frozen: 167249285 hash: BxueduRmDa12A1soB9obebgx34pmicFFab37cXzGfP8r accounts_delta: Fw78BdWe2ers1wWNW2hNdCikzRqbMk5myQbeixgzbnV4 signature_count: 295 last_blockhash: 5BxWarhTStdTBrPAdYRpBsrCgZoB7QSYsLbzd4Shz8uJ capitalization: 1568506868592776648
[2022-12-15T02:11:34.204250824Z INFO  solana_runtime::bank] bank frozen: 167249286 hash: 9kFZNx49fQ5ugE3i3dzfAFvPPpw4EWVQYqnkxGH8GFWp accounts_delta: Hj62JqY1Yn2Pgd2hQPP6PCLc2adDcGbq29Qsk7yHhc6Z signature_count: 3337 last_blockhash: FEmFN2zPnuaR6tYn2uxTF7Rq1hDnYbtKejbUW8KDJwVv capitalization: 1568506868584431908
[2022-12-15T02:11:34.579724607Z INFO  solana_runtime::bank] bank frozen: 167249287 hash: 7Lc3dTaGrSouBPVAUjKWxqGJJEY13fhsT3u3vMMmJNwN accounts_delta: A1rVU2jr9Tx5suudZgHLyG2DnTurqe1E3vdxSaBs1RQN signature_count: 615 last_blockhash: 9iZHWHaMBemZPrtRfcw5LmVTxEhq8biAxsp9UupVuu2V capitalization: 1568506868582893048

simulations

solana-ledger-tool -- --ledger ~/ledger-testnet-for-tracer-slot-167249284/ simulate-leader-blocks --halt-at-slot 167249283 < ~/ledger-testnet-for-tracer-slot-167249284/banking_trace/events

run 1

[2022-12-15T12:58:02.021673503Z INFO  solana_runtime::bank] bank frozen: 167249284 hash: A7CHyVsPdvdr9TTWsezBhZ5f7cwh15vZwruWHsiPxWBF accounts_delta: DBGAgKw76zTm1epRZucVHHryYCuBvwpmk3WjNt31qGJ5 signature_count: 4279 last_blockhash: 84HMxHV6W4o6BvJh455Zk6Yg2aU1K2TDBFpTvxuEuYG4 (overrode) capitalization: 1568506868592562638
[2022-12-15T12:58:02.378853369Z INFO  solana_runtime::bank] bank frozen: 167249285 hash: 4Z9rZ4a9REmvZxLutt8NrX3FypVfmoc2tF79fRUKsro9 accounts_delta: 2EEaA51L4zrdHXzJtDSUV1AUH4cfTRwowAxxBWN3y8pS signature_count: 38 last_blockhash: 5BxWarhTStdTBrPAdYRpBsrCgZoB7QSYsLbzd4Shz8uJ (overrode) capitalization: 1568506868592466648
[2022-12-15T12:58:02.731311881Z INFO  solana_runtime::bank] bank frozen: 167249286 hash: 2XAmArx2ZCwyrrk75cSpQvaJnzetSSzM6h5VWKbM6D3P accounts_delta: GXsHjdPja2D7tAehiW8Rm9pXn8yAMXN22TqkweQWnJmA signature_count: 2903 last_blockhash: FEmFN2zPnuaR6tYn2uxTF7Rq1hDnYbtKejbUW8KDJwVv (overrode) capitalization: 1568506868585206908
[2022-12-15T12:58:03.086141445Z INFO  solana_runtime::bank] bank frozen: 167249287 hash: EvLSJDb48LQ1GNZdEwF3HvJwDTHXWVWAUyZCWb5p9ABB accounts_delta: 4CRv7CXVsQBwaxguK2NkwppaESw2wA927HwiZ3P6QYZE signature_count: 926 last_blockhash: 9iZHWHaMBemZPrtRfcw5LmVTxEhq8biAxsp9UupVuu2V (overrode) capitalization: 1568506868582890548

run 2

[2022-12-15T13:51:51.502432467Z INFO  solana_runtime::bank] bank frozen: 167249284 hash: A7CHyVsPdvdr9TTWsezBhZ5f7cwh15vZwruWHsiPxWBF accounts_delta: DBGAgKw76zTm1epRZucVHHryYCuBvwpmk3WjNt31qGJ5 signature_count: 4279 last_blockhash: 84HMxHV6W4o6BvJh455Zk6Yg2aU1K2TDBFpTvxuEuYG4 (overrode) capitalization: 1568506868592562638
[2022-12-15T13:51:51.851199203Z INFO  solana_runtime::bank] bank frozen: 167249285 hash: FJjqJAHDUn2vnPAWYS1LXZGkdStaq4APPJhKeqbJ4zXa accounts_delta: 6y3CuPnnL1ihsmHqmvrnyqwQmrjwc6jw7uwdZitLbsYy signature_count: 35 last_blockhash: 5BxWarhTStdTBrPAdYRpBsrCgZoB7QSYsLbzd4Shz8uJ (overrode) capitalization: 1568506868592474228
[2022-12-15T13:51:52.209053360Z INFO  solana_runtime::bank] bank frozen: 167249286 hash: 6rJCYAvEz1NZUwhRUGup2KBqn5GUCgpf3UxASbwohFA7 accounts_delta: 9ckTs5Dh9JP1uczQCLLs3WCi9fgRSAfVZPBvPUHaoEn2 signature_count: 2967 last_blockhash: FEmFN2zPnuaR6tYn2uxTF7Rq1hDnYbtKejbUW8KDJwVv (overrode) capitalization: 1568506868585054488
[2022-12-15T13:51:52.561096931Z INFO  solana_runtime::bank] bank frozen: 167249287 hash: Aq3A18AavAxSLtzCerQoxj8H7xyFMvgV54woQJgBdp3D accounts_delta: CfpjKSVzrAsiBJg6aWAJgP4rnsoQJ2vAg387svaynbTw signature_count: 742 last_blockhash: 9iZHWHaMBemZPrtRfcw5LmVTxEhq8biAxsp9UupVuu2V (overrode) capitalization: 1568506868583198048

run 3

[2022-12-15T13:57:52.584911941Z INFO  solana_runtime::bank] bank frozen: 167249284 hash: A7CHyVsPdvdr9TTWsezBhZ5f7cwh15vZwruWHsiPxWBF accounts_delta: DBGAgKw76zTm1epRZucVHHryYCuBvwpmk3WjNt31qGJ5 signature_count: 4279 last_blockhash: 84HMxHV6W4o6BvJh455Zk6Yg2aU1K2TDBFpTvxuEuYG4 (overrode) capitalization: 1568506868592562638
[2022-12-15T13:57:52.939980442Z INFO  solana_runtime::bank] bank frozen: 167249285 hash: FJjqJAHDUn2vnPAWYS1LXZGkdStaq4APPJhKeqbJ4zXa accounts_delta: 6y3CuPnnL1ihsmHqmvrnyqwQmrjwc6jw7uwdZitLbsYy signature_count: 35 last_blockhash: 5BxWarhTStdTBrPAdYRpBsrCgZoB7QSYsLbzd4Shz8uJ (overrode) capitalization: 1568506868592474228
[2022-12-15T13:57:53.297190669Z INFO  solana_runtime::bank] bank frozen: 167249286 hash: CSxuJcty1mr51qAXHBBQuzW5rU7gcUGd816Xn8bEEphW accounts_delta: HcaCRaPQZq9sbi34rZ8pAVWJeqUQdfk3TuS5A7popmv1 signature_count: 3024 last_blockhash: FEmFN2zPnuaR6tYn2uxTF7Rq1hDnYbtKejbUW8KDJwVv (overrode) capitalization: 1568506868584911988
[2022-12-15T13:57:53.651976182Z INFO  solana_runtime::bank] bank frozen: 167249287 hash: 61RrTLsmYpyLBTrWYbhtYBBKKLBkm8nCfKWLMk1G6cFx accounts_delta: 3becG5MNfMAbwWzxK3Fis85dgNEHUSo9N78MLZe15cDn signature_count: 681 last_blockhash: 9iZHWHaMBemZPrtRfcw5LmVTxEhq8biAxsp9UupVuu2V (overrode) capitalization: 1568506868583208048

Summary of Changes

Fixes #

@ryoqun ryoqun marked this pull request as draft December 15, 2022 13:47
@ryoqun ryoqun mentioned this pull request Dec 15, 2022
Merged
11 tasks
@ryoqun ryoqun force-pushed the banking-tracer-with-simulator-wip branch 3 times, most recently from 21db768 to 5fa3f19 Compare December 21, 2022 03:31
@ryoqun ryoqun force-pushed the banking-tracer branch 2 times, most recently from 1482637 to b76ed3d Compare December 21, 2022 13:03
@ryoqun ryoqun force-pushed the banking-tracer-with-simulator-wip branch from 8880bff to 3a068cf Compare December 21, 2022 13:52
@ryoqun ryoqun force-pushed the banking-tracer-with-simulator-wip branch from e68df27 to e20fe52 Compare January 15, 2023 03:57
ryoqun
ryoqun commented Jan 15, 2023
View reviewed changes
core/src/banking_trace.rs
@@ -547,3 +555,467 @@ mod tests {
for_test::drop_and_clean_temp_dir_unless_suppressed(temp_dir);
}
}

// This creates a simulated environment around the banking stage to reproduce leader's blocks based
Copy link
Owner Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

here

@ryoqun ryoqun force-pushed the banking-tracer branch 6 times, most recently from 14ec1d1 to 54042b2 Compare January 25, 2023 03:50
@ryoqun ryoqun force-pushed the banking-tracer branch 2 times, most recently from 947701c to 84e9520 Compare January 25, 2023 08:26
@ryoqun ryoqun force-pushed the banking-tracer-with-simulator-wip branch from e20fe52 to 9adf66e Compare January 25, 2023 12:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@ryoqun