Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

sql: disable span-config on flakey 5node tests #75281

Merged
merged 1 commit into from
Jan 22, 2022

Conversation

cucaroach
Copy link
Contributor

@cucaroach cucaroach commented Jan 21, 2022

Temporary fix for #72802 and 5node/distsql_enum CI failures.

Due to #73876 these tests have become flakey.
With the disable-span-configs option 70 runs of make stress on the opt logic tests pass.

Release note: None

@cucaroach cucaroach requested a review from a team as a code owner January 21, 2022 17:53
@cockroach-teamcity
Copy link
Member

This change is Reviewable

@@ -1,4 +1,5 @@
# LogicTest: 5node-default-configs !5node-metadata
# cluster-opt: disable-span-configs
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we want to file an issue so that this can be removed when fixed?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 #75282

Temporary fix for cockroachdb#72802

Due to cockroachdb#73876 these tests have become flakey. With the
disable-span-configs option 70 runs of make stress on the opt logic
tests pass.

Release note: None
@cucaroach
Copy link
Contributor Author

bors r+

@craig
Copy link
Contributor

craig bot commented Jan 21, 2022

Build failed (retrying...):

@craig
Copy link
Contributor

craig bot commented Jan 21, 2022

This PR was included in a batch that was canceled, it will be automatically retried

@craig
Copy link
Contributor

craig bot commented Jan 21, 2022

Build failed (retrying...):

@craig
Copy link
Contributor

craig bot commented Jan 21, 2022

Build failed (retrying...):

@craig
Copy link
Contributor

craig bot commented Jan 22, 2022

Build succeeded:

@craig craig bot merged commit fdfd893 into cockroachdb:master Jan 22, 2022
@cucaroach
Copy link
Contributor Author

For posterity the issue this "fixed" was #74933 and not #72802

irfansharif added a commit to irfansharif/cockroach that referenced this pull request Jan 24, 2022
We opted this test out of using the span configs infra in cockroachdb#75281 after
observing a CI flake. Following the analysis in the last commit, it may
have been due to stale distsender caches affecting the physical plan
generated.

This fix is speculative because I was unable to repro the original flake
under stress. Attempt (successful after 1000s of runs on GCE worker over
20+ minutes):

    dev test pkg/sql/logictest \
    -f 'TestLogic/^5node-disk$/distsql_enum' \
    --show-logs -v --stress --stress-args '-p 4' -- --test_arg -show-sql

Release note: None
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants