-
Notifications
You must be signed in to change notification settings - Fork 6.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix quorum check when recovering broken etcd cluster (with etcd 3.5.x) #8126
Conversation
Skipping CI for Draft Pull Request. |
b853a86
to
1a009ef
Compare
❌ Failed nightly : ✔️ Green jobs with fix : |
@@ -20,10 +20,9 @@ | |||
when: | |||
- groups['broken_etcd'] | |||
|
|||
# When there is an error, everything is printed in stderr_lines, even "is healthy" messages. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Not anymore 🎉 @EppO do you remember our etcd 3.4.x crusade ? brings back some memories 😆
/approve |
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: cristicalin, floryut The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
/lgtm |
What type of PR is this?
/kind bug
What this PR does / why we need it:
Since updating to etcd 3.5.x, the recover broken etcd role is failing.
A bug introduced in 3.4.x has been fixed in 3.5.x, the bug was sending every output to error if the cluster was unhealthy when using the endpoint_health command.
The second changes is related to
etcdctl member list
taking a few seconds to display the newly created members, so retry is now needed.Which issue(s) this PR fixes:
None
Special notes for your reviewer:
etcdctl endpoint health
for a broken etcd cluster with 3.4.x version:etcdctl endpoint health
for a broken etcd cluster with 3.5.x version:Does this PR introduce a user-facing change?: