Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Request pd leader timeout after any pd disconnected #9243

Closed
Lily2025 opened this issue Jul 19, 2024 · 1 comment · Fixed by #9252
Closed

Request pd leader timeout after any pd disconnected #9243

Lily2025 opened this issue Jul 19, 2024 · 1 comment · Fixed by #9252

Comments

@Lily2025
Copy link

Lily2025 commented Jul 19, 2024

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

1、run ch workload
2、inject network partition of pd leader(deploy with 3 pd)
chaos start time ~ end time:
2024-07-15 06:46:45 ~ 2024-07-15 06:56:46

2. What did you expect to see? (Required)

no unexpected error

3. What did you see instead (Required)

workload report error
[2024/07/15 06:53:55.972 +08:00] [INFO] [collection.go:304] ["[2024-07-14 22:53:55] execute run failed, err execute query q15 failed Error 1105: other error for mpp stream: Code: 0, e.displayText() = DB::Exception: get region failed: 4 : Deadline Exceeded, e.what() = DB::Exception,\r\n"]

4. What is your TiFlash version? (Required)

/tiflash/tiflash version
TiFlash
Release Version: v8.2.0-alpha
Edition: Community
Git Commit Hash: d3bd50c
Git Branch: heads/refs/tags/v8.2.0-alpha
UTC Build Time: 2024-07-12 11:42:25
Enable Features: jemalloc sm4(GmSSL) avx2 avx512 unwind thinlto
Profile: RELWITHDEBINFO
Compiler: clang++ 17.0.6

Raft Proxy
Git Commit Hash: 87b668286174b152df0f7ef4b738a5f46857eeff
Git Commit Branch: HEAD
UTC Build Time: 2024-07-12 11:48:12
Rust Version: rustc 1.77.0-nightly (89e2160c4 2023-12-27)
Storage Engine: tiflash
Prometheus Prefix: tiflash_proxy_
Profile: release
Enable Features: external-jemalloc portable sse test-engine-kv-rocksdb test-engine-raft-raft-engine openssl-vendored portable sse test-engine-kv-rocksdb test-engine-raft-raft-engine openssl-vendored
2024-07-15T06:36:37.267+0800

@Lily2025 Lily2025 added the type/bug The issue is confirmed as a bug. label Jul 19, 2024
@Lily2025
Copy link
Author

/assign Lloyd-Pottiger

ti-chi-bot bot pushed a commit that referenced this issue Jul 22, 2024
@JaySon-Huang JaySon-Huang changed the title workload report “Error 1105: other error for mpp stream: Code: 0, e.displayText() = DB::Exception: get region failed: 4 : Deadline Exceeded, e.what() = DB::Exception” after injection network of pd leader Queries failed after injection network of pd leader Jul 24, 2024
@Lloyd-Pottiger Lloyd-Pottiger changed the title Queries failed after injection network of pd leader Request pd leader timeout after any pd disconnected Jul 24, 2024
@ti-chi-bot ti-chi-bot bot closed this as completed in 335522f Jul 24, 2024
ti-chi-bot bot pushed a commit that referenced this issue Jul 31, 2024
…onnected (release-6.1) (#9272)

close #9243

update client-c to fix request pd leader timeout after any pd disconnected

Signed-off-by: Lloyd-Pottiger <[email protected]>
ti-chi-bot bot pushed a commit that referenced this issue Jul 31, 2024
…onnected (release-8.1) (#9271)

close #9243

update client-c to fix request pd leader timeout after any pd disconnected

Signed-off-by: Lloyd-Pottiger <[email protected]>
ti-chi-bot bot pushed a commit that referenced this issue Jul 31, 2024
…onnected (release-6.5) (#9268)

close #9243

update client-c to fix request pd leader timeout after any pd disconnected

Signed-off-by: Lloyd-Pottiger <[email protected]>
ti-chi-bot bot pushed a commit that referenced this issue Jul 31, 2024
…onnected (release-7.1) (#9269)

close #9243

update client-c to fix request pd leader timeout after any pd disconnected

Signed-off-by: Lloyd-Pottiger <[email protected]>
ti-chi-bot bot added a commit that referenced this issue Aug 5, 2024
…onnected (release-7.5) (#9270)

close #9243

update client-c to fix request pd leader timeout after any pd disconnected

Signed-off-by: Lloyd-Pottiger <[email protected]>

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants