Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Thin client1 #290

Closed
Closed

Conversation

CriesofCarrots
Copy link
Contributor

On new ThinClient, thin_client1 spawns a thread that listens on a channel for Request messages. When it receives one, it sets up the appropriate Udpsocket, sends the request to the server, and polls for a response. Uses mio crate to test the socket for readiness and data available, and offers customization of retries and timeouts.
client-demo1 and multinode1 contain the syntax changes needed in client-demo and multinode respectively to utilize thin_client1

@garious
Copy link
Contributor

garious commented May 31, 2018

This is a more incremental approach than I had imagined. Go ahead and replace the original files with your new ones. It'll mean you'll need to rebase regularly until the PR is merged, but it'll get rid of all the code duplication, and let us see just the changes to the original code.

@codecov
Copy link

codecov bot commented May 31, 2018

Codecov Report

Merging #290 into master will decrease coverage by 0.09%.
The diff coverage is 81.48%.

Impacted file tree graph

@@           Coverage Diff            @@
##           master    #290     +/-   ##
========================================
- Coverage    88.5%   88.4%   -0.1%     
========================================
  Files          32      32             
  Lines        2983    3061     +78     
========================================
+ Hits         2640    2706     +66     
- Misses        343     355     +12
Impacted Files Coverage Δ
src/lib.rs 100% <ø> (ø) ⬆️
src/thin_client.rs 86.95% <81.48%> (-1.05%) ⬇️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c9fd5d7...550e47f. Read the comment docs.

self.sender.send((Message::Requests(req), response_sender)).expect("send request to thread");
let handle = thread::spawn(move || {
loop{
match response_receiver.try_recv() {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All these try_recv() calls look like they can be recv().

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yep, checks out, thanks!

transactions_server_addr,
transactions_addr,
);
match receiver.try_recv() {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This can be recv(), but using try_recv() in a loop with no sleep(), you should see 100% CPU usage when there's no work to be done. That's no good!

.send_to(&data, &self.transactions_addr)
/// Send a signed Transaction to the server for processing.
pub fn transfer_signed(&self, tx: Transaction) -> io::Result<()> {
let (response_sender, _response_receiver) = channel();
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That ignored _response_receiver indicates the sending of transactions doesn't need to participate in this async framework. We might want to do transaction retries, but that'd be a consequence of a different Request/Response control message. For example, we might add a CheckForSignature request and if it replies NotFound, then we'd retry sending the transaction.

pub fn get_balance(&mut self, pubkey: &PublicKey) -> io::Result<i64> {
trace!("get_balance");
info!("get_balance");
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is moving this to info intentional?

self.process_response(resp);
}
});
let response = handle.join().expect("response data from thread");
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Calling join() right after spawn() tells us we don't need a thread here.

}
});
let response = handle.join().expect("response data from thread");
self.process_response(response);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

process_response() needs to be done on the background thread, because the responses from several requests can arrive out of order. Imagine, for example, a get_balance() that returns a Future. The user may initiate dozens of get_balance() requests and then call wait() on all futures separately. The last wait() would return shortly after the slowest response and not after the sum of all synchronous calls.

@garious
Copy link
Contributor

garious commented Jun 7, 2018

@CriesofCarrots, I'm going to close this PR for now. Feel free to reopen when it's ready for additional review.

@garious garious closed this Jun 7, 2018
@CriesofCarrots CriesofCarrots deleted the thin_client1 branch November 8, 2019 14:59
godmodegalactus pushed a commit to blockworks-foundation/solana that referenced this pull request Jun 10, 2024
only reroute if relayer connected (solana-labs#123)
feat: add client tls config (solana-labs#121)
remove extra val (solana-labs#129)
fix clippy (solana-labs#130)
copy all binaries to docker-output (solana-labs#131)
Ledger tool halts at slot passed to create-snapshot (solana-labs#118)
update program submodule (solana-labs#133)
quick fix for tips and clearing old bundles (solana-labs#135)
update submodule to new program (solana-labs#136)
Improve stake-meta-generator usability (solana-labs#134)
pinning submodule head (solana-labs#140)
Use BundleAccountLocker when handling tip txs (solana-labs#147)
Add metrics for relayer + block engine proxy (solana-labs#149)
Build claim-mev in docker (solana-labs#141)
Rework bundle receiving and add metrics (solana-labs#152) (solana-labs#154)
update submodule + dev files (solana-labs#158)
Deterministically find tip amounts, add meta to stake info, and cleanup pubkey/strings in MEV tips (solana-labs#159)
update jito-programs submodule (solana-labs#160)
Separate MEV tip related workflow (solana-labs#161)
Add block builder fee protos (solana-labs#162)
fix jito programs (solana-labs#163)
update submodule so autosnapshot exits out of ledger tool early (solana-labs#164)
Pipe through block builder fee (solana-labs#167)
pull in new snapshot code (solana-labs#171)
block builder bug (solana-labs#172)

Pull in new slack autosnapshot submodule (solana-labs#174)

sort stake meta json and use int math (solana-labs#176)

add accountsdb conn submod (solana-labs#169)

Update tip distribution parameters (solana-labs#177)

new submodules (solana-labs#180)

Add buildkite link for jito CI (solana-labs#183)

Fixed broken links to repositories (solana-labs#184)

Changed from ssh to https transfer for clone

Seg/update submods (solana-labs#187)

fix tests (solana-labs#190)

rm geyser submod (solana-labs#192)

rm dangling geyser references (solana-labs#193)

fix syntax err (solana-labs#195)

use deterministic req ids in batch calls (solana-labs#199)

update jito-programs

revert cargo

update Cargo lock

update with path fix

fix cargo

update autosnapshot with block lookback (solana-labs#201)

[JIT-460] When claiming mev tips, skip accounts that won't have min rent exempt amount after claiming (solana-labs#203)

Add logging for sol balance desired (solana-labs#205)

* add logging

* add logging

* update msg

* tweak vars

update submodule (solana-labs#204)

use efficient data structures when calling batch_simulate_bundles (solana-labs#206)

[JIT-504] Add low balance check in uploading merkle roots (solana-labs#209)

add config to simulate on top of working bank (solana-labs#211)

rm frozen bank check

simulate_bundle rpc bugfixes (solana-labs#214)

rm frozen bank check in simulate_bundle rpc method

[JIT-519] Store ClaimStatus address in merkle-root-json (solana-labs#210)

* add files

* switch to include bump

update submodule (solana-labs#217)

add amount filter (solana-labs#218)

update autosnapshot (solana-labs#222)

Print TX error in Bundles (solana-labs#223)

add new args to support single relayer and block-engine endpoints (solana-labs#224)

point to new jito-programs submod and invoke updated init tda instruction (solana-labs#228)

fix clippy errors (solana-labs#230)

fix validator start scripts (solana-labs#232)

Point README to gitbook (solana-labs#237)

use packaged cargo bin to build (solana-labs#239)

Add validator identity pubkey to StakeMeta (solana-labs#226)

The vote account associated with a validator is not a permanent link, so log the validator identity as well.

bugfix: conditionally compile with debug flags (solana-labs#240)

Seg/tip distributor master (solana-labs#242)

* validate tree nodes

* fix unit tests

* pr feedback

* bump jito-programs submod

Simplify bootstrapping (solana-labs#241)

* startup without precompile

* update spacing

* use release mode

* spacing

fix validation

rm validation skip

Account for block builder fee when generating excess tip balance (solana-labs#247)

Improve docker caching

delay constructing claim mev txs (solana-labs#253)

fix stake meta tests from bb fee (solana-labs#254)

fix tests

Buffer bundles that exceed cost model (solana-labs#225)

* buffer bundles that exceed cost model

clear qos failed bundles buffer if not leader soon (solana-labs#260)

update Cargo.lock to correct solana versions in jito-programs submodule (solana-labs#265)

fix simulate_bundle client and better error handling (solana-labs#267)

update submod (solana-labs#272)

Preallocate Bundle Cost (solana-labs#238)

fix Dockerfile (solana-labs#278)

Fix Tests (solana-labs#279)

Fix Tests (solana-labs#281)

* fix tests

update jito-programs submod (solana-labs#282)

add reclaim rent workflow (solana-labs#283)

update jito-programs submod

fix clippy errs

rm wrong assertion and swap out file write fn call (solana-labs#292)

Remove security.md (solana-labs#293)

demote frequent relayer_stage-stream_error to warn (solana-labs#275)

account for case where TDA exists but not allocated (solana-labs#295)

implement better retries for tip-distributor workflows (solana-labs#297)

limit number of concurrent rpc calls (solana-labs#298)

Discard Empty Packet Batches (solana-labs#299)

Identity Hotswap (solana-labs#290)

small fixes (solana-labs#305)

Set backend config from admin rpc (solana-labs#304)

Admin Shred Receiver Change (solana-labs#306)

Seg/rm bundle UUID (solana-labs#309)

Fix github workflow to recursively clone (solana-labs#327)

Add recursive checkout for downstream-project-spl.yaml (solana-labs#341)

Use cluster info functions for tpu (solana-labs#345)

Use git rev-parse for git sha

Remove blacklisted tx from message_hash_to_transaction (solana-labs#374)

Updates bootstrap and start scripts needed for local dev. (solana-labs#384)

Remove Deprecated Cli Args (solana-labs#387)

Master Rebase

improve simulate_bundle errors and response (solana-labs#404)

derive Clone on accountoverrides (solana-labs#416)

Add upsert to AccountOverrides (solana-labs#419)

update jito-programs (solana-labs#430)

[JIT-1661] Faster Autosnapshot (solana-labs#436)

Reverts simulate_transaction result calls to upstream (solana-labs#446)

Don't unlock accounts in TransactionBatches used during simulation (solana-labs#449)

first pass at wiring up jito-plugin (solana-labs#428)

[JIT-1713] Fix bundle's blockspace preallocation (solana-labs#489)

[JIT-1708] Fix TOC TOU condition for relayer and block engine config (solana-labs#491)

[JIT-1710] - Optimize Bundle Consumer Checks (solana-labs#490)

Add Blockhash Metrics to Bundle Committer (solana-labs#500)

add priority fee ix to mev-claim (solana-labs#520)

Update Autosnapshot (solana-labs#548)

Run MEV claims + reclaiming rent-exempt amounts in parallel. (solana-labs#582)

Update CI (solana-labs#584)
- Add recursive submodule checkouts.
- Re-add solana-secondary step
- More release fixes

Fix release process

Backports solana-labs#595: correctly initialize account overrides (solana-labs#596)

Fix: Ensure set contact info to UDP port instead of QUIC (Backport solana-labs#601 to v1.18) (solana-labs#602)

Buffer bundles that exceed processing time and make the allowed processing time longer (solana-labs#610)
vovkman pushed a commit to helius-labs/solana that referenced this pull request Jun 13, 2024
only reroute if relayer connected (solana-labs#123)
feat: add client tls config (solana-labs#121)
remove extra val (solana-labs#129)
fix clippy (solana-labs#130)
copy all binaries to docker-output (solana-labs#131)
Ledger tool halts at slot passed to create-snapshot (solana-labs#118)
update program submodule (solana-labs#133)
quick fix for tips and clearing old bundles (solana-labs#135)
update submodule to new program (solana-labs#136)
Improve stake-meta-generator usability (solana-labs#134)
pinning submodule head (solana-labs#140)
Use BundleAccountLocker when handling tip txs (solana-labs#147)
Add metrics for relayer + block engine proxy (solana-labs#149)
Build claim-mev in docker (solana-labs#141)
Rework bundle receiving and add metrics (solana-labs#152) (solana-labs#154)
update submodule + dev files (solana-labs#158)
Deterministically find tip amounts, add meta to stake info, and cleanup pubkey/strings in MEV tips (solana-labs#159)
update jito-programs submodule (solana-labs#160)
Separate MEV tip related workflow (solana-labs#161)
Add block builder fee protos (solana-labs#162)
fix jito programs (solana-labs#163)
update submodule so autosnapshot exits out of ledger tool early (solana-labs#164)
Pipe through block builder fee (solana-labs#167)
pull in new snapshot code (solana-labs#171)
block builder bug (solana-labs#172)

Pull in new slack autosnapshot submodule (solana-labs#174)

sort stake meta json and use int math (solana-labs#176)

add accountsdb conn submod (solana-labs#169)

Update tip distribution parameters (solana-labs#177)

new submodules (solana-labs#180)

Add buildkite link for jito CI (solana-labs#183)

Fixed broken links to repositories (solana-labs#184)

Changed from ssh to https transfer for clone

Seg/update submods (solana-labs#187)

fix tests (solana-labs#190)

rm geyser submod (solana-labs#192)

rm dangling geyser references (solana-labs#193)

fix syntax err (solana-labs#195)

use deterministic req ids in batch calls (solana-labs#199)

update jito-programs

revert cargo

update Cargo lock

update with path fix

fix cargo

update autosnapshot with block lookback (solana-labs#201)

[JIT-460] When claiming mev tips, skip accounts that won't have min rent exempt amount after claiming (solana-labs#203)

Add logging for sol balance desired (solana-labs#205)

* add logging

* add logging

* update msg

* tweak vars

update submodule (solana-labs#204)

use efficient data structures when calling batch_simulate_bundles (solana-labs#206)

[JIT-504] Add low balance check in uploading merkle roots (solana-labs#209)

add config to simulate on top of working bank (solana-labs#211)

rm frozen bank check

simulate_bundle rpc bugfixes (solana-labs#214)

rm frozen bank check in simulate_bundle rpc method

[JIT-519] Store ClaimStatus address in merkle-root-json (solana-labs#210)

* add files

* switch to include bump

update submodule (solana-labs#217)

add amount filter (solana-labs#218)

update autosnapshot (solana-labs#222)

Print TX error in Bundles (solana-labs#223)

add new args to support single relayer and block-engine endpoints (solana-labs#224)

point to new jito-programs submod and invoke updated init tda instruction (solana-labs#228)

fix clippy errors (solana-labs#230)

fix validator start scripts (solana-labs#232)

Point README to gitbook (solana-labs#237)

use packaged cargo bin to build (solana-labs#239)

Add validator identity pubkey to StakeMeta (solana-labs#226)

The vote account associated with a validator is not a permanent link, so log the validator identity as well.

bugfix: conditionally compile with debug flags (solana-labs#240)

Seg/tip distributor master (solana-labs#242)

* validate tree nodes

* fix unit tests

* pr feedback

* bump jito-programs submod

Simplify bootstrapping (solana-labs#241)

* startup without precompile

* update spacing

* use release mode

* spacing

fix validation

rm validation skip

Account for block builder fee when generating excess tip balance (solana-labs#247)

Improve docker caching

delay constructing claim mev txs (solana-labs#253)

fix stake meta tests from bb fee (solana-labs#254)

fix tests

Buffer bundles that exceed cost model (solana-labs#225)

* buffer bundles that exceed cost model

clear qos failed bundles buffer if not leader soon (solana-labs#260)

update Cargo.lock to correct solana versions in jito-programs submodule (solana-labs#265)

fix simulate_bundle client and better error handling (solana-labs#267)

update submod (solana-labs#272)

Preallocate Bundle Cost (solana-labs#238)

fix Dockerfile (solana-labs#278)

Fix Tests (solana-labs#279)

Fix Tests (solana-labs#281)

* fix tests

update jito-programs submod (solana-labs#282)

add reclaim rent workflow (solana-labs#283)

update jito-programs submod

fix clippy errs

rm wrong assertion and swap out file write fn call (solana-labs#292)

Remove security.md (solana-labs#293)

demote frequent relayer_stage-stream_error to warn (solana-labs#275)

account for case where TDA exists but not allocated (solana-labs#295)

implement better retries for tip-distributor workflows (solana-labs#297)

limit number of concurrent rpc calls (solana-labs#298)

Discard Empty Packet Batches (solana-labs#299)

Identity Hotswap (solana-labs#290)

small fixes (solana-labs#305)

Set backend config from admin rpc (solana-labs#304)

Admin Shred Receiver Change (solana-labs#306)

Seg/rm bundle UUID (solana-labs#309)

Fix github workflow to recursively clone (solana-labs#327)

Add recursive checkout for downstream-project-spl.yaml (solana-labs#341)

Use cluster info functions for tpu (solana-labs#345)

Use git rev-parse for git sha

Remove blacklisted tx from message_hash_to_transaction (solana-labs#374)

Updates bootstrap and start scripts needed for local dev. (solana-labs#384)

Remove Deprecated Cli Args (solana-labs#387)

Master Rebase

improve simulate_bundle errors and response (solana-labs#404)

derive Clone on accountoverrides (solana-labs#416)

Add upsert to AccountOverrides (solana-labs#419)

update jito-programs (solana-labs#430)

[JIT-1661] Faster Autosnapshot (solana-labs#436)

Reverts simulate_transaction result calls to upstream (solana-labs#446)

Don't unlock accounts in TransactionBatches used during simulation (solana-labs#449)

first pass at wiring up jito-plugin (solana-labs#428)

[JIT-1713] Fix bundle's blockspace preallocation (solana-labs#489)

[JIT-1708] Fix TOC TOU condition for relayer and block engine config (solana-labs#491)

[JIT-1710] - Optimize Bundle Consumer Checks (solana-labs#490)

Add Blockhash Metrics to Bundle Committer (solana-labs#500)

add priority fee ix to mev-claim (solana-labs#520)

Update Autosnapshot (solana-labs#548)

Run MEV claims + reclaiming rent-exempt amounts in parallel. (solana-labs#582)

Update CI (solana-labs#584)
- Add recursive submodule checkouts.
- Re-add solana-secondary step
- More release fixes

Fix release process

Backports solana-labs#595: correctly initialize account overrides (solana-labs#596)

Fix: Ensure set contact info to UDP port instead of QUIC (Backport solana-labs#601 to v1.18) (solana-labs#602)

Buffer bundles that exceed processing time and make the allowed processing time longer (solana-labs#610)
ruuda pushed a commit to ChorusOne/solana that referenced this pull request Jul 15, 2024
only reroute if relayer connected (solana-labs#123)
feat: add client tls config (solana-labs#121)
remove extra val (solana-labs#129)
fix clippy (solana-labs#130)
copy all binaries to docker-output (solana-labs#131)
Ledger tool halts at slot passed to create-snapshot (solana-labs#118)
update program submodule (solana-labs#133)
quick fix for tips and clearing old bundles (solana-labs#135)
update submodule to new program (solana-labs#136)
Improve stake-meta-generator usability (solana-labs#134)
pinning submodule head (solana-labs#140)
Use BundleAccountLocker when handling tip txs (solana-labs#147)
Add metrics for relayer + block engine proxy (solana-labs#149)
Build claim-mev in docker (solana-labs#141)
Rework bundle receiving and add metrics (solana-labs#152) (solana-labs#154)
update submodule + dev files (solana-labs#158)
Deterministically find tip amounts, add meta to stake info, and cleanup pubkey/strings in MEV tips (solana-labs#159)
update jito-programs submodule (solana-labs#160)
Separate MEV tip related workflow (solana-labs#161)
Add block builder fee protos (solana-labs#162)
fix jito programs (solana-labs#163)
update submodule so autosnapshot exits out of ledger tool early (solana-labs#164)
Pipe through block builder fee (solana-labs#167)
pull in new snapshot code (solana-labs#171)
block builder bug (solana-labs#172)

Pull in new slack autosnapshot submodule (solana-labs#174)

sort stake meta json and use int math (solana-labs#176)

add accountsdb conn submod (solana-labs#169)

Update tip distribution parameters (solana-labs#177)

new submodules (solana-labs#180)

Add buildkite link for jito CI (solana-labs#183)

Fixed broken links to repositories (solana-labs#184)

Changed from ssh to https transfer for clone

Seg/update submods (solana-labs#187)

fix tests (solana-labs#190)

rm geyser submod (solana-labs#192)

rm dangling geyser references (solana-labs#193)

fix syntax err (solana-labs#195)

use deterministic req ids in batch calls (solana-labs#199)

update jito-programs

revert cargo

update Cargo lock

update with path fix

fix cargo

update autosnapshot with block lookback (solana-labs#201)

[JIT-460] When claiming mev tips, skip accounts that won't have min rent exempt amount after claiming (solana-labs#203)

Add logging for sol balance desired (solana-labs#205)

* add logging

* add logging

* update msg

* tweak vars

update submodule (solana-labs#204)

use efficient data structures when calling batch_simulate_bundles (solana-labs#206)

[JIT-504] Add low balance check in uploading merkle roots (solana-labs#209)

add config to simulate on top of working bank (solana-labs#211)

rm frozen bank check

simulate_bundle rpc bugfixes (solana-labs#214)

rm frozen bank check in simulate_bundle rpc method

[JIT-519] Store ClaimStatus address in merkle-root-json (solana-labs#210)

* add files

* switch to include bump

update submodule (solana-labs#217)

add amount filter (solana-labs#218)

update autosnapshot (solana-labs#222)

Print TX error in Bundles (solana-labs#223)

add new args to support single relayer and block-engine endpoints (solana-labs#224)

point to new jito-programs submod and invoke updated init tda instruction (solana-labs#228)

fix clippy errors (solana-labs#230)

fix validator start scripts (solana-labs#232)

Point README to gitbook (solana-labs#237)

use packaged cargo bin to build (solana-labs#239)

Add validator identity pubkey to StakeMeta (solana-labs#226)

The vote account associated with a validator is not a permanent link, so log the validator identity as well.

bugfix: conditionally compile with debug flags (solana-labs#240)

Seg/tip distributor master (solana-labs#242)

* validate tree nodes

* fix unit tests

* pr feedback

* bump jito-programs submod

Simplify bootstrapping (solana-labs#241)

* startup without precompile

* update spacing

* use release mode

* spacing

fix validation

rm validation skip

Account for block builder fee when generating excess tip balance (solana-labs#247)

Improve docker caching

delay constructing claim mev txs (solana-labs#253)

fix stake meta tests from bb fee (solana-labs#254)

fix tests

Buffer bundles that exceed cost model (solana-labs#225)

* buffer bundles that exceed cost model

clear qos failed bundles buffer if not leader soon (solana-labs#260)

update Cargo.lock to correct solana versions in jito-programs submodule (solana-labs#265)

fix simulate_bundle client and better error handling (solana-labs#267)

update submod (solana-labs#272)

Preallocate Bundle Cost (solana-labs#238)

fix Dockerfile (solana-labs#278)

Fix Tests (solana-labs#279)

Fix Tests (solana-labs#281)

* fix tests

update jito-programs submod (solana-labs#282)

add reclaim rent workflow (solana-labs#283)

update jito-programs submod

fix clippy errs

rm wrong assertion and swap out file write fn call (solana-labs#292)

Remove security.md (solana-labs#293)

demote frequent relayer_stage-stream_error to warn (solana-labs#275)

account for case where TDA exists but not allocated (solana-labs#295)

implement better retries for tip-distributor workflows (solana-labs#297)

limit number of concurrent rpc calls (solana-labs#298)

Discard Empty Packet Batches (solana-labs#299)

Identity Hotswap (solana-labs#290)

small fixes (solana-labs#305)

Set backend config from admin rpc (solana-labs#304)

Admin Shred Receiver Change (solana-labs#306)

Seg/rm bundle UUID (solana-labs#309)

Fix github workflow to recursively clone (solana-labs#327)

Add recursive checkout for downstream-project-spl.yaml (solana-labs#341)

Use cluster info functions for tpu (solana-labs#345)

Use git rev-parse for git sha

Remove blacklisted tx from message_hash_to_transaction (solana-labs#374)

Updates bootstrap and start scripts needed for local dev. (solana-labs#384)

Remove Deprecated Cli Args (solana-labs#387)

Master Rebase

improve simulate_bundle errors and response (solana-labs#404)

derive Clone on accountoverrides (solana-labs#416)

Add upsert to AccountOverrides (solana-labs#419)

update jito-programs (solana-labs#430)

[JIT-1661] Faster Autosnapshot (solana-labs#436)

Reverts simulate_transaction result calls to upstream (solana-labs#446)

Don't unlock accounts in TransactionBatches used during simulation (solana-labs#449)

first pass at wiring up jito-plugin (solana-labs#428)

[JIT-1713] Fix bundle's blockspace preallocation (solana-labs#489)

[JIT-1708] Fix TOC TOU condition for relayer and block engine config (solana-labs#491)

[JIT-1710] - Optimize Bundle Consumer Checks (solana-labs#490)

Add Blockhash Metrics to Bundle Committer (solana-labs#500)

add priority fee ix to mev-claim (solana-labs#520)

Update Autosnapshot (solana-labs#548)

Run MEV claims + reclaiming rent-exempt amounts in parallel. (solana-labs#582)

Update CI (solana-labs#584)
- Add recursive submodule checkouts.
- Re-add solana-secondary step
- More release fixes

Fix release process

Backports solana-labs#595: correctly initialize account overrides (solana-labs#596)

Fix: Ensure set contact info to UDP port instead of QUIC (Backport solana-labs#601 to v1.18) (solana-labs#602)

Buffer bundles that exceed processing time and make the allowed processing time longer (solana-labs#610)

update jito-programs submodule
Szymongib pushed a commit to ChorusOne/solana that referenced this pull request Jul 29, 2024
only reroute if relayer connected (solana-labs#123)
feat: add client tls config (solana-labs#121)
remove extra val (solana-labs#129)
fix clippy (solana-labs#130)
copy all binaries to docker-output (solana-labs#131)
Ledger tool halts at slot passed to create-snapshot (solana-labs#118)
update program submodule (solana-labs#133)
quick fix for tips and clearing old bundles (solana-labs#135)
update submodule to new program (solana-labs#136)
Improve stake-meta-generator usability (solana-labs#134)
pinning submodule head (solana-labs#140)
Use BundleAccountLocker when handling tip txs (solana-labs#147)
Add metrics for relayer + block engine proxy (solana-labs#149)
Build claim-mev in docker (solana-labs#141)
Rework bundle receiving and add metrics (solana-labs#152) (solana-labs#154)
update submodule + dev files (solana-labs#158)
Deterministically find tip amounts, add meta to stake info, and cleanup pubkey/strings in MEV tips (solana-labs#159)
update jito-programs submodule (solana-labs#160)
Separate MEV tip related workflow (solana-labs#161)
Add block builder fee protos (solana-labs#162)
fix jito programs (solana-labs#163)
update submodule so autosnapshot exits out of ledger tool early (solana-labs#164)
Pipe through block builder fee (solana-labs#167)
pull in new snapshot code (solana-labs#171)
block builder bug (solana-labs#172)

Pull in new slack autosnapshot submodule (solana-labs#174)

sort stake meta json and use int math (solana-labs#176)

add accountsdb conn submod (solana-labs#169)

Update tip distribution parameters (solana-labs#177)

new submodules (solana-labs#180)

Add buildkite link for jito CI (solana-labs#183)

Fixed broken links to repositories (solana-labs#184)

Changed from ssh to https transfer for clone

Seg/update submods (solana-labs#187)

fix tests (solana-labs#190)

rm geyser submod (solana-labs#192)

rm dangling geyser references (solana-labs#193)

fix syntax err (solana-labs#195)

use deterministic req ids in batch calls (solana-labs#199)

update jito-programs

revert cargo

update Cargo lock

update with path fix

fix cargo

update autosnapshot with block lookback (solana-labs#201)

[JIT-460] When claiming mev tips, skip accounts that won't have min rent exempt amount after claiming (solana-labs#203)

Add logging for sol balance desired (solana-labs#205)

* add logging

* add logging

* update msg

* tweak vars

update submodule (solana-labs#204)

use efficient data structures when calling batch_simulate_bundles (solana-labs#206)

[JIT-504] Add low balance check in uploading merkle roots (solana-labs#209)

add config to simulate on top of working bank (solana-labs#211)

rm frozen bank check

simulate_bundle rpc bugfixes (solana-labs#214)

rm frozen bank check in simulate_bundle rpc method

[JIT-519] Store ClaimStatus address in merkle-root-json (solana-labs#210)

* add files

* switch to include bump

update submodule (solana-labs#217)

add amount filter (solana-labs#218)

update autosnapshot (solana-labs#222)

Print TX error in Bundles (solana-labs#223)

add new args to support single relayer and block-engine endpoints (solana-labs#224)

point to new jito-programs submod and invoke updated init tda instruction (solana-labs#228)

fix clippy errors (solana-labs#230)

fix validator start scripts (solana-labs#232)

Point README to gitbook (solana-labs#237)

use packaged cargo bin to build (solana-labs#239)

Add validator identity pubkey to StakeMeta (solana-labs#226)

The vote account associated with a validator is not a permanent link, so log the validator identity as well.

bugfix: conditionally compile with debug flags (solana-labs#240)

Seg/tip distributor master (solana-labs#242)

* validate tree nodes

* fix unit tests

* pr feedback

* bump jito-programs submod

Simplify bootstrapping (solana-labs#241)

* startup without precompile

* update spacing

* use release mode

* spacing

fix validation

rm validation skip

Account for block builder fee when generating excess tip balance (solana-labs#247)

Improve docker caching

delay constructing claim mev txs (solana-labs#253)

fix stake meta tests from bb fee (solana-labs#254)

fix tests

Buffer bundles that exceed cost model (solana-labs#225)

* buffer bundles that exceed cost model

clear qos failed bundles buffer if not leader soon (solana-labs#260)

update Cargo.lock to correct solana versions in jito-programs submodule (solana-labs#265)

fix simulate_bundle client and better error handling (solana-labs#267)

update submod (solana-labs#272)

Preallocate Bundle Cost (solana-labs#238)

fix Dockerfile (solana-labs#278)

Fix Tests (solana-labs#279)

Fix Tests (solana-labs#281)

* fix tests

update jito-programs submod (solana-labs#282)

add reclaim rent workflow (solana-labs#283)

update jito-programs submod

fix clippy errs

rm wrong assertion and swap out file write fn call (solana-labs#292)

Remove security.md (solana-labs#293)

demote frequent relayer_stage-stream_error to warn (solana-labs#275)

account for case where TDA exists but not allocated (solana-labs#295)

implement better retries for tip-distributor workflows (solana-labs#297)

limit number of concurrent rpc calls (solana-labs#298)

Discard Empty Packet Batches (solana-labs#299)

Identity Hotswap (solana-labs#290)

small fixes (solana-labs#305)

Set backend config from admin rpc (solana-labs#304)

Admin Shred Receiver Change (solana-labs#306)

Seg/rm bundle UUID (solana-labs#309)

Fix github workflow to recursively clone (solana-labs#327)

Add recursive checkout for downstream-project-spl.yaml (solana-labs#341)

Use cluster info functions for tpu (solana-labs#345)

Use git rev-parse for git sha

Remove blacklisted tx from message_hash_to_transaction (solana-labs#374)

Updates bootstrap and start scripts needed for local dev. (solana-labs#384)

Remove Deprecated Cli Args (solana-labs#387)

Master Rebase

improve simulate_bundle errors and response (solana-labs#404)

derive Clone on accountoverrides (solana-labs#416)

Add upsert to AccountOverrides (solana-labs#419)

update jito-programs (solana-labs#430)

[JIT-1661] Faster Autosnapshot (solana-labs#436)

Reverts simulate_transaction result calls to upstream (solana-labs#446)

Don't unlock accounts in TransactionBatches used during simulation (solana-labs#449)

first pass at wiring up jito-plugin (solana-labs#428)

[JIT-1713] Fix bundle's blockspace preallocation (solana-labs#489)

[JIT-1708] Fix TOC TOU condition for relayer and block engine config (solana-labs#491)

[JIT-1710] - Optimize Bundle Consumer Checks (solana-labs#490)

Add Blockhash Metrics to Bundle Committer (solana-labs#500)

add priority fee ix to mev-claim (solana-labs#520)

Update Autosnapshot (solana-labs#548)

Run MEV claims + reclaiming rent-exempt amounts in parallel. (solana-labs#582)

Update CI (solana-labs#584)
- Add recursive submodule checkouts.
- Re-add solana-secondary step
- More release fixes

Fix release process

Backports solana-labs#595: correctly initialize account overrides (solana-labs#596)

Fix: Ensure set contact info to UDP port instead of QUIC (Backport solana-labs#601 to v1.18) (solana-labs#602)

Buffer bundles that exceed processing time and make the allowed processing time longer (solana-labs#610)

update jito-programs submodule
vovkman pushed a commit to helius-labs/solana that referenced this pull request Aug 20, 2024
only reroute if relayer connected (solana-labs#123)
feat: add client tls config (solana-labs#121)
remove extra val (solana-labs#129)
fix clippy (solana-labs#130)
copy all binaries to docker-output (solana-labs#131)
Ledger tool halts at slot passed to create-snapshot (solana-labs#118)
update program submodule (solana-labs#133)
quick fix for tips and clearing old bundles (solana-labs#135)
update submodule to new program (solana-labs#136)
Improve stake-meta-generator usability (solana-labs#134)
pinning submodule head (solana-labs#140)
Use BundleAccountLocker when handling tip txs (solana-labs#147)
Add metrics for relayer + block engine proxy (solana-labs#149)
Build claim-mev in docker (solana-labs#141)
Rework bundle receiving and add metrics (solana-labs#152) (solana-labs#154)
update submodule + dev files (solana-labs#158)
Deterministically find tip amounts, add meta to stake info, and cleanup pubkey/strings in MEV tips (solana-labs#159)
update jito-programs submodule (solana-labs#160)
Separate MEV tip related workflow (solana-labs#161)
Add block builder fee protos (solana-labs#162)
fix jito programs (solana-labs#163)
update submodule so autosnapshot exits out of ledger tool early (solana-labs#164)
Pipe through block builder fee (solana-labs#167)
pull in new snapshot code (solana-labs#171)
block builder bug (solana-labs#172)

Pull in new slack autosnapshot submodule (solana-labs#174)

sort stake meta json and use int math (solana-labs#176)

add accountsdb conn submod (solana-labs#169)

Update tip distribution parameters (solana-labs#177)

new submodules (solana-labs#180)

Add buildkite link for jito CI (solana-labs#183)

Fixed broken links to repositories (solana-labs#184)

Changed from ssh to https transfer for clone

Seg/update submods (solana-labs#187)

fix tests (solana-labs#190)

rm geyser submod (solana-labs#192)

rm dangling geyser references (solana-labs#193)

fix syntax err (solana-labs#195)

use deterministic req ids in batch calls (solana-labs#199)

update jito-programs

revert cargo

update Cargo lock

update with path fix

fix cargo

update autosnapshot with block lookback (solana-labs#201)

[JIT-460] When claiming mev tips, skip accounts that won't have min rent exempt amount after claiming (solana-labs#203)

Add logging for sol balance desired (solana-labs#205)

* add logging

* add logging

* update msg

* tweak vars

update submodule (solana-labs#204)

use efficient data structures when calling batch_simulate_bundles (solana-labs#206)

[JIT-504] Add low balance check in uploading merkle roots (solana-labs#209)

add config to simulate on top of working bank (solana-labs#211)

rm frozen bank check

simulate_bundle rpc bugfixes (solana-labs#214)

rm frozen bank check in simulate_bundle rpc method

[JIT-519] Store ClaimStatus address in merkle-root-json (solana-labs#210)

* add files

* switch to include bump

update submodule (solana-labs#217)

add amount filter (solana-labs#218)

update autosnapshot (solana-labs#222)

Print TX error in Bundles (solana-labs#223)

add new args to support single relayer and block-engine endpoints (solana-labs#224)

point to new jito-programs submod and invoke updated init tda instruction (solana-labs#228)

fix clippy errors (solana-labs#230)

fix validator start scripts (solana-labs#232)

Point README to gitbook (solana-labs#237)

use packaged cargo bin to build (solana-labs#239)

Add validator identity pubkey to StakeMeta (solana-labs#226)

The vote account associated with a validator is not a permanent link, so log the validator identity as well.

bugfix: conditionally compile with debug flags (solana-labs#240)

Seg/tip distributor master (solana-labs#242)

* validate tree nodes

* fix unit tests

* pr feedback

* bump jito-programs submod

Simplify bootstrapping (solana-labs#241)

* startup without precompile

* update spacing

* use release mode

* spacing

fix validation

rm validation skip

Account for block builder fee when generating excess tip balance (solana-labs#247)

Improve docker caching

delay constructing claim mev txs (solana-labs#253)

fix stake meta tests from bb fee (solana-labs#254)

fix tests

Buffer bundles that exceed cost model (solana-labs#225)

* buffer bundles that exceed cost model

clear qos failed bundles buffer if not leader soon (solana-labs#260)

update Cargo.lock to correct solana versions in jito-programs submodule (solana-labs#265)

fix simulate_bundle client and better error handling (solana-labs#267)

update submod (solana-labs#272)

Preallocate Bundle Cost (solana-labs#238)

fix Dockerfile (solana-labs#278)

Fix Tests (solana-labs#279)

Fix Tests (solana-labs#281)

* fix tests

update jito-programs submod (solana-labs#282)

add reclaim rent workflow (solana-labs#283)

update jito-programs submod

fix clippy errs

rm wrong assertion and swap out file write fn call (solana-labs#292)

Remove security.md (solana-labs#293)

demote frequent relayer_stage-stream_error to warn (solana-labs#275)

account for case where TDA exists but not allocated (solana-labs#295)

implement better retries for tip-distributor workflows (solana-labs#297)

limit number of concurrent rpc calls (solana-labs#298)

Discard Empty Packet Batches (solana-labs#299)

Identity Hotswap (solana-labs#290)

small fixes (solana-labs#305)

Set backend config from admin rpc (solana-labs#304)

Admin Shred Receiver Change (solana-labs#306)

Seg/rm bundle UUID (solana-labs#309)

Fix github workflow to recursively clone (solana-labs#327)

Add recursive checkout for downstream-project-spl.yaml (solana-labs#341)

Use cluster info functions for tpu (solana-labs#345)

Use git rev-parse for git sha

Remove blacklisted tx from message_hash_to_transaction (solana-labs#374)

Updates bootstrap and start scripts needed for local dev. (solana-labs#384)

Remove Deprecated Cli Args (solana-labs#387)

Master Rebase

improve simulate_bundle errors and response (solana-labs#404)

derive Clone on accountoverrides (solana-labs#416)

Add upsert to AccountOverrides (solana-labs#419)

update jito-programs (solana-labs#430)

[JIT-1661] Faster Autosnapshot (solana-labs#436)

Reverts simulate_transaction result calls to upstream (solana-labs#446)

Don't unlock accounts in TransactionBatches used during simulation (solana-labs#449)

first pass at wiring up jito-plugin (solana-labs#428)

[JIT-1713] Fix bundle's blockspace preallocation (solana-labs#489)

[JIT-1708] Fix TOC TOU condition for relayer and block engine config (solana-labs#491)

[JIT-1710] - Optimize Bundle Consumer Checks (solana-labs#490)

Add Blockhash Metrics to Bundle Committer (solana-labs#500)

add priority fee ix to mev-claim (solana-labs#520)

Update Autosnapshot (solana-labs#548)

Run MEV claims + reclaiming rent-exempt amounts in parallel. (solana-labs#582)

Update CI (solana-labs#584)
- Add recursive submodule checkouts.
- Re-add solana-secondary step

Add more release fixes (solana-labs#585)

Fix more release urls (solana-labs#588)

[JIT-1812] Fix blocking mutexs (solana-labs#495)

 [JIT-1711] Compare the unprocessed transaction storage BundleStorage against a constant instead of VecDeque::capacity() (solana-labs#587)

Automatically rebase Jito-Solana on a periodic basis. Send message on slack during any failures or success.

Fix periodic rebase solana-labs#594

Fixes the following bugs in the periodic rebase:
Sends multiple messages on failure instead of one
Cancels entire job if one branch fails

Ignore buildkite curl errors for rebasing and try to keep curling until job times out (solana-labs#597)

Sleep longer waiting for buildkite to start (solana-labs#598)

correctly initialize account overrides (solana-labs#595)

Fix: Ensure set contact info to UDP port instead of QUIC (solana-labs#603)

Add fast replay branch to daily rebase (solana-labs#607)

take a snapshot of all bundle accounts before sim (solana-labs#13) (solana-labs#615)

update jito-programs submodule
techiepriyansh pushed a commit to ChorusOne/solana that referenced this pull request Oct 2, 2024
only reroute if relayer connected (solana-labs#123)
feat: add client tls config (solana-labs#121)
remove extra val (solana-labs#129)
fix clippy (solana-labs#130)
copy all binaries to docker-output (solana-labs#131)
Ledger tool halts at slot passed to create-snapshot (solana-labs#118)
update program submodule (solana-labs#133)
quick fix for tips and clearing old bundles (solana-labs#135)
update submodule to new program (solana-labs#136)
Improve stake-meta-generator usability (solana-labs#134)
pinning submodule head (solana-labs#140)
Use BundleAccountLocker when handling tip txs (solana-labs#147)
Add metrics for relayer + block engine proxy (solana-labs#149)
Build claim-mev in docker (solana-labs#141)
Rework bundle receiving and add metrics (solana-labs#152) (solana-labs#154)
update submodule + dev files (solana-labs#158)
Deterministically find tip amounts, add meta to stake info, and cleanup pubkey/strings in MEV tips (solana-labs#159)
update jito-programs submodule (solana-labs#160)
Separate MEV tip related workflow (solana-labs#161)
Add block builder fee protos (solana-labs#162)
fix jito programs (solana-labs#163)
update submodule so autosnapshot exits out of ledger tool early (solana-labs#164)
Pipe through block builder fee (solana-labs#167)
pull in new snapshot code (solana-labs#171)
block builder bug (solana-labs#172)

Pull in new slack autosnapshot submodule (solana-labs#174)

sort stake meta json and use int math (solana-labs#176)

add accountsdb conn submod (solana-labs#169)

Update tip distribution parameters (solana-labs#177)

new submodules (solana-labs#180)

Add buildkite link for jito CI (solana-labs#183)

Fixed broken links to repositories (solana-labs#184)

Changed from ssh to https transfer for clone

Seg/update submods (solana-labs#187)

fix tests (solana-labs#190)

rm geyser submod (solana-labs#192)

rm dangling geyser references (solana-labs#193)

fix syntax err (solana-labs#195)

use deterministic req ids in batch calls (solana-labs#199)

update jito-programs

revert cargo

update Cargo lock

update with path fix

fix cargo

update autosnapshot with block lookback (solana-labs#201)

[JIT-460] When claiming mev tips, skip accounts that won't have min rent exempt amount after claiming (solana-labs#203)

Add logging for sol balance desired (solana-labs#205)

* add logging

* add logging

* update msg

* tweak vars

update submodule (solana-labs#204)

use efficient data structures when calling batch_simulate_bundles (solana-labs#206)

[JIT-504] Add low balance check in uploading merkle roots (solana-labs#209)

add config to simulate on top of working bank (solana-labs#211)

rm frozen bank check

simulate_bundle rpc bugfixes (solana-labs#214)

rm frozen bank check in simulate_bundle rpc method

[JIT-519] Store ClaimStatus address in merkle-root-json (solana-labs#210)

* add files

* switch to include bump

update submodule (solana-labs#217)

add amount filter (solana-labs#218)

update autosnapshot (solana-labs#222)

Print TX error in Bundles (solana-labs#223)

add new args to support single relayer and block-engine endpoints (solana-labs#224)

point to new jito-programs submod and invoke updated init tda instruction (solana-labs#228)

fix clippy errors (solana-labs#230)

fix validator start scripts (solana-labs#232)

Point README to gitbook (solana-labs#237)

use packaged cargo bin to build (solana-labs#239)

Add validator identity pubkey to StakeMeta (solana-labs#226)

The vote account associated with a validator is not a permanent link, so log the validator identity as well.

bugfix: conditionally compile with debug flags (solana-labs#240)

Seg/tip distributor master (solana-labs#242)

* validate tree nodes

* fix unit tests

* pr feedback

* bump jito-programs submod

Simplify bootstrapping (solana-labs#241)

* startup without precompile

* update spacing

* use release mode

* spacing

fix validation

rm validation skip

Account for block builder fee when generating excess tip balance (solana-labs#247)

Improve docker caching

delay constructing claim mev txs (solana-labs#253)

fix stake meta tests from bb fee (solana-labs#254)

fix tests

Buffer bundles that exceed cost model (solana-labs#225)

* buffer bundles that exceed cost model

clear qos failed bundles buffer if not leader soon (solana-labs#260)

update Cargo.lock to correct solana versions in jito-programs submodule (solana-labs#265)

fix simulate_bundle client and better error handling (solana-labs#267)

update submod (solana-labs#272)

Preallocate Bundle Cost (solana-labs#238)

fix Dockerfile (solana-labs#278)

Fix Tests (solana-labs#279)

Fix Tests (solana-labs#281)

* fix tests

update jito-programs submod (solana-labs#282)

add reclaim rent workflow (solana-labs#283)

update jito-programs submod

fix clippy errs

rm wrong assertion and swap out file write fn call (solana-labs#292)

Remove security.md (solana-labs#293)

demote frequent relayer_stage-stream_error to warn (solana-labs#275)

account for case where TDA exists but not allocated (solana-labs#295)

implement better retries for tip-distributor workflows (solana-labs#297)

limit number of concurrent rpc calls (solana-labs#298)

Discard Empty Packet Batches (solana-labs#299)

Identity Hotswap (solana-labs#290)

small fixes (solana-labs#305)

Set backend config from admin rpc (solana-labs#304)

Admin Shred Receiver Change (solana-labs#306)

Seg/rm bundle UUID (solana-labs#309)

Fix github workflow to recursively clone (solana-labs#327)

Add recursive checkout for downstream-project-spl.yaml (solana-labs#341)

Use cluster info functions for tpu (solana-labs#345)

Use git rev-parse for git sha

Remove blacklisted tx from message_hash_to_transaction (solana-labs#374)

Updates bootstrap and start scripts needed for local dev. (solana-labs#384)

Remove Deprecated Cli Args (solana-labs#387)

Master Rebase

improve simulate_bundle errors and response (solana-labs#404)

derive Clone on accountoverrides (solana-labs#416)

Add upsert to AccountOverrides (solana-labs#419)

update jito-programs (solana-labs#430)

[JIT-1661] Faster Autosnapshot (solana-labs#436)

Reverts simulate_transaction result calls to upstream (solana-labs#446)

Don't unlock accounts in TransactionBatches used during simulation (solana-labs#449)

first pass at wiring up jito-plugin (solana-labs#428)

[JIT-1713] Fix bundle's blockspace preallocation (solana-labs#489)

[JIT-1708] Fix TOC TOU condition for relayer and block engine config (solana-labs#491)

[JIT-1710] - Optimize Bundle Consumer Checks (solana-labs#490)

Add Blockhash Metrics to Bundle Committer (solana-labs#500)

add priority fee ix to mev-claim (solana-labs#520)

Update Autosnapshot (solana-labs#548)

Run MEV claims + reclaiming rent-exempt amounts in parallel. (solana-labs#582)

Update CI (solana-labs#584)
- Add recursive submodule checkouts.
- Re-add solana-secondary step

Add more release fixes (solana-labs#585)

Fix more release urls (solana-labs#588)

[JIT-1812] Fix blocking mutexs (solana-labs#495)

 [JIT-1711] Compare the unprocessed transaction storage BundleStorage against a constant instead of VecDeque::capacity() (solana-labs#587)

Automatically rebase Jito-Solana on a periodic basis. Send message on slack during any failures or success.

Fix periodic rebase solana-labs#594

Fixes the following bugs in the periodic rebase:
Sends multiple messages on failure instead of one
Cancels entire job if one branch fails

Ignore buildkite curl errors for rebasing and try to keep curling until job times out (solana-labs#597)

Sleep longer waiting for buildkite to start (solana-labs#598)

correctly initialize account overrides (solana-labs#595)

Fix: Ensure set contact info to UDP port instead of QUIC (solana-labs#603)

Add fast replay branch to daily rebase (solana-labs#607)

take a snapshot of all bundle accounts before sim (#13) (solana-labs#615)

update jito-programs submodule
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants