gomod: update pdclient to support backoff mechanism for memberLoop

[HuSharp]

Signed-off-by: husharp [email protected]<!--

Thank you for contributing to TiDB!

PR Title Format:

1. pkg [, pkg2, pkg3]: what's changed
2. *: what's changed

-->

What problem does this PR solve?

Issue Number: close #46770, ref tikv/pd#6556

Problem Summary:

• Add backoff mechanism
  When waiting for the goroutine to update, the expo function can be used to backoff to sleep when an error is encountered.

PR Summary

Add backoff mechanism

• When waiting for the goroutine to update, the expo function can be used to backoff to sleep when an error is encountered.

Reproduce Step

1. enable fail point, like gRPC is throttling, cannot read from etcd.
   curl -X PUT -d 'return(10)' http://tc-pd-1.tc-pd-peer.csn-simulator-big-cluster-vd62g.svc:2379/pd/api/v1/fail/github.com/tikv/pd/pkg/etcdutil/SlowEtcdKVGet

2. simulate pd lost leader
   curl -X PUT -d 'return("2346857576170797299")' http://tc-pd-1.tc-pd-peer.csn-simulator-big-cluster-vd62g.svc:2379/pd/api/v1/fail/github.com/tikv/pd/server/exitCampaignLeader

Reproduce Result

Grpc request GetMember keeps high:

TiKV side show

PR Effect

The Grpc GetMember call was reduced from 3.2k to 170, which is relative to the TiDB numbers and client requests for triaging checkLeader.

For 20 * tidb 3 * PD 50 * TiKV
170 = (50 * 3 / 3 / 3[TiKV side] + 20 * 2 [TiDB side]) * 3[PD Num]

And more tests are necessary to ensure that no further issues arise.

What is changed and how it works?

Check List

test by pd
Tests

• Unit test
• Integration test

Release note

Please refer to Release Notes Language Style Guide to write a quality release note.

update pdclient to support backoff mechanism for memberLoop

[codecov]

Codecov Report

Merging #46769 (d6e8d0e) into master (a8bd506) will decrease coverage by 0.4456%.
Report is 12 commits behind head on master.
The diff coverage is n/a.

Additional details and impacted files

@@               Coverage Diff                @@
##             master     #46769        +/-   ##
================================================
- Coverage   73.2795%   72.8340%   -0.4456%     
================================================
  Files          1330       1352        +22     
  Lines        397448     405934      +8486     
================================================
+ Hits         291248     295658      +4410     
- Misses        87588      91656      +4068     
- Partials      18612      18620         +8     

Flag	Coverage Δ
integration	28.3436% <ø> (?)
unit	73.4885% <ø> (+0.2090%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Components	Coverage Δ
dumpling	54.0444% <ø> (ø)
parser	84.9922% <ø> (+0.0010%)	⬆️
br	48.6177% <ø> (-4.2738%)	⬇️

[HuSharp]

/test check-dev

[HuSharp]

/test unit-test

[tiprow]

@HuSharp: The specified target(s) for /test were not found.
The following commands are available to trigger required jobs:

• /test tiprow_fast_test

Use /test all to run all jobs.

In response to this:

/test check-dev

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[tiprow]

@HuSharp: The specified target(s) for /test were not found.
The following commands are available to trigger required jobs:

• /test tiprow_fast_test

Use /test all to run all jobs.

In response to this:

/test unit-test

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[HuSharp]

/check-issue-triage-complete

[HuSharp]

/retest-required

[HuSharp]

@JmPotato @nolouch PTAL, thx!

[HuSharp]

release-6.5 had been updated by https://github.com/pingcap/tidb/pull/46616/files#diff-33ef32bf6c23acb95f5902d7097b7a1d5128ca061167ec0716715b0b9eeaa5f6L94

[ti-chi-bot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: hawkingrei, nolouch

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [hawkingrei]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[ti-chi-bot]

[LGTM Timeline notifier]

Timeline:

• 2023-09-11 03:32:33.809934191 +0000 UTC m=+240135.734490586: ☑️ agreed by hawkingrei.
• 2023-09-12 08:41:29.091708942 +0000 UTC m=+345071.016265441: ☑️ agreed by nolouch.

[HuSharp]

/test build

[tiprow]

@HuSharp: The specified target(s) for /test were not found.
The following commands are available to trigger required jobs:

• /test tiprow_fast_test

Use /test all to run all jobs.

In response to this:

/test build

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[HuSharp]

/retest-required

[HuSharp]

/test unit-test

[tiprow]

@HuSharp: The specified target(s) for /test were not found.
The following commands are available to trigger required jobs:

• /test tiprow_fast_test

Use /test all to run all jobs.

In response to this:

/test unit-test

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[hawkingrei]

/retest

[ti-chi-bot]

In response to a cherrypick label: new pull request created to branch release-6.5: #46954.

[ti-chi-bot]

In response to a cherrypick label: new pull request created to branch release-7.1: #46955.