Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kvserver: de-flake TestRangefeedCheckpointsRecoverFromLeaseExpiration #75587

Conversation

irfansharif
Copy link
Contributor

@irfansharif irfansharif commented Jan 26, 2022

Fixes #75098.

We didn't account for a possibly stale distsender cache earlier,
misrouting the LeaseInfo request to the last known leaseholder. By
providing a hint with the new leaseholder, we were also making an
assertion on cache freshness. We skip the hint and do just what the test
wants -- ensuring a lease renewal. Repro-ed within seconds before this
commit:

dev test pkg/kv/kvserver \
  -f TestRangefeedCheckpointsRecoverFromLeaseExpiration --stress

Release note: None

@cockroach-teamcity
Copy link
Member

This change is Reviewable

We didn't account for a possibly stale distsender cache earlier,
misrouting the LeaseInfo request to the last known leaseholder. By
providing a hint with the new leaseholder, we were also making an
assertion on cache freshness. We skip the hint and do just what the test
wants -- ensuring a lease renewal. Repro-ed within seconds before this
commit:

    dev test pkg/kv/kvserver \
      -f TestRangefeedCheckpointsRecoverFromLeaseExpiration --stress

Release note: None
@irfansharif irfansharif force-pushed the 220126.deflake-TestRangefeedCheckpointsRecoverFromLeaseExpiration branch from 352b0f7 to 071ecc5 Compare January 26, 2022 23:45
Copy link
Contributor

@ajwerner ajwerner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:lgtm:

Reviewed 1 of 1 files at r1, all commit messages.
Reviewable status: :shipit: complete! 1 of 0 LGTMs obtained (waiting on @arulajmani and @nvanbenschoten)

@irfansharif
Copy link
Contributor Author

Thanks!

bors r+

@craig
Copy link
Contributor

craig bot commented Jan 27, 2022

Build failed (retrying...):

@craig
Copy link
Contributor

craig bot commented Jan 27, 2022

Build failed (retrying...):

@craig
Copy link
Contributor

craig bot commented Jan 27, 2022

Build failed:

@irfansharif
Copy link
Contributor Author

Unrelated failures (though my fault too: #75609).

bors r+

@craig
Copy link
Contributor

craig bot commented Jan 27, 2022

Build failed (retrying...):

@craig
Copy link
Contributor

craig bot commented Jan 27, 2022

Build succeeded:

@craig craig bot merged commit fa93c68 into cockroachdb:master Jan 27, 2022
@irfansharif irfansharif deleted the 220126.deflake-TestRangefeedCheckpointsRecoverFromLeaseExpiration branch January 27, 2022 17:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

kv/kvserver: TestRangefeedCheckpointsRecoverFromLeaseExpiration failed
3 participants