Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ccl/multiregionccl: TestMultiRegionDataDriven failed #77908

Closed
cockroach-teamcity opened this issue Mar 16, 2022 · 5 comments · Fixed by #86339
Closed

ccl/multiregionccl: TestMultiRegionDataDriven failed #77908

cockroach-teamcity opened this issue Mar 16, 2022 · 5 comments · Fixed by #86339
Assignees
Labels
branch-release-22.1 Used to mark GA and release blockers, technical advisories, and bugs for 22.1 C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot.

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Mar 16, 2022

ccl/multiregionccl.TestMultiRegionDataDriven failed with artifacts on release-22.1 @ a1c1879e01ceee79a81693c67a1dba184b5fc1b1:

=== RUN   TestMultiRegionDataDriven/global_tables
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2704/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:1:
        new-cluster [1 args]
        <no input to command>
        ----
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2704/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:4:
        exec-sql [1 args]
        CREATE DATABASE db PRIMARY REGION "us-east-1" REGIONS  "us-west-1", "us-central-1";
        ----
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2704/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:8:
        exec-sql [1 args]
        CREATE TABLE db.global(k INT PRIMARY KEY, v INT) LOCALITY GLOBAL;
        ----
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/2704/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:12:
        exec-sql [1 args]
        INSERT INTO db.global VALUES (1, 1), (2,2)
        ----
Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

  • TAGS=bazel,gss,deadlock

Same failure on other branches

/cc @cockroachdb/multiregion

This test on roachdash | Improve this report!

Jira issue: CRDB-13833

@cockroach-teamcity cockroach-teamcity added branch-release-22.1 Used to mark GA and release blockers, technical advisories, and bugs for 22.1 C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. labels Mar 16, 2022
@cockroach-teamcity
Copy link
Member Author

ccl/multiregionccl.TestMultiRegionDataDriven failed with artifacts on release-22.1 @ ff4e23e53388d3639f4b1b23b66e87d436556a8f:

        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3361/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:63:
        refresh-range-descriptor-cache [2 args]
        SELECT * FROM db.global WHERE k = 2
        ----
        LEAD_FOR_GLOBAL_READS
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3361/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:68:
        trace-sql [1 args]
        SELECT * FROM db.global WHERE k = 1
        ----
        served locally: true
        served via follower read: true
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3361/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:74:
        refresh-range-descriptor-cache [2 args]
        SELECT * FROM db.global WHERE k = 2
        ----
        LEAD_FOR_GLOBAL_READS
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3361/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:81:
        trace-sql [1 args]
        SELECT * FROM db.global WHERE k = 1
        ----
        served locally: false
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3361/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:86:
        exec-sql [1 args]
        ALTER DATABASE db ADD REGION "eu-central-1"
        ----
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3361/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:90:
        wait-for-zone-config-changes [6 args]
        <no input to command>
        ----
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3361/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:93:
        refresh-range-descriptor-cache [2 args]
        SELECT * FROM db.global WHERE k = 2
        ----
        LEAD_FOR_GLOBAL_READS
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3361/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:98: SELECT * FROM db.global WHERE k = 1
        expected:
        served locally: true
        served via follower read: true
        
        found:
        served locally: true
        served via follower read: false
    --- FAIL: TestMultiRegionDataDriven/global_tables (24.19s)
Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

  • TAGS=bazel,gss

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

ccl/multiregionccl.TestMultiRegionDataDriven failed with artifacts on release-22.1 @ 8c867d72534db2c64beb1a36bde9f8345bfd5e9f:

        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3364/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:63:
        refresh-range-descriptor-cache [2 args]
        SELECT * FROM db.global WHERE k = 2
        ----
        LEAD_FOR_GLOBAL_READS
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3364/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:68:
        trace-sql [1 args]
        SELECT * FROM db.global WHERE k = 1
        ----
        served locally: true
        served via follower read: true
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3364/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:74:
        refresh-range-descriptor-cache [2 args]
        SELECT * FROM db.global WHERE k = 2
        ----
        LEAD_FOR_GLOBAL_READS
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3364/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:81:
        trace-sql [1 args]
        SELECT * FROM db.global WHERE k = 1
        ----
        served locally: false
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3364/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:86:
        exec-sql [1 args]
        ALTER DATABASE db ADD REGION "eu-central-1"
        ----
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3364/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:90:
        wait-for-zone-config-changes [6 args]
        <no input to command>
        ----
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3364/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:93:
        refresh-range-descriptor-cache [2 args]
        SELECT * FROM db.global WHERE k = 2
        ----
        LEAD_FOR_GLOBAL_READS
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3364/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:98: SELECT * FROM db.global WHERE k = 1
        expected:
        served locally: true
        served via follower read: true
        
        found:
        served locally: true
        served via follower read: false
    --- FAIL: TestMultiRegionDataDriven/global_tables (27.23s)
Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

  • TAGS=bazel,gss

Same failure on other branches

This test on roachdash | Improve this report!

@ajwerner
Copy link
Contributor

@arulajmani may I kindly request that you sort out who is going to have a look?

@cockroach-teamcity
Copy link
Member Author

ccl/multiregionccl.TestMultiRegionDataDriven failed with artifacts on release-22.1 @ 73ddb31f9b156f429f93a62cb9ce22da1fb2fe83:

        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3767/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:63:
        refresh-range-descriptor-cache [2 args]
        SELECT * FROM db.global WHERE k = 2
        ----
        LEAD_FOR_GLOBAL_READS
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3767/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:68:
        trace-sql [1 args]
        SELECT * FROM db.global WHERE k = 1
        ----
        served locally: true
        served via follower read: true
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3767/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:74:
        refresh-range-descriptor-cache [2 args]
        SELECT * FROM db.global WHERE k = 2
        ----
        LEAD_FOR_GLOBAL_READS
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3767/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:81:
        trace-sql [1 args]
        SELECT * FROM db.global WHERE k = 1
        ----
        served locally: false
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3767/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:86:
        exec-sql [1 args]
        ALTER DATABASE db ADD REGION "eu-central-1"
        ----
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3767/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:90:
        wait-for-zone-config-changes [6 args]
        <no input to command>
        ----
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3767/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:93:
        refresh-range-descriptor-cache [2 args]
        SELECT * FROM db.global WHERE k = 2
        ----
        LEAD_FOR_GLOBAL_READS
    datadriven_test.go:122: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3767/execroot/cockroach/bazel-out/k8-dbg/bin/pkg/ccl/multiregionccl/multiregionccl_test_/multiregionccl_test.runfiles/cockroach/pkg/ccl/multiregionccl/testdata/global_tables:98: SELECT * FROM db.global WHERE k = 1
        expected:
        served locally: true
        served via follower read: true
        
        found:
        served locally: true
        served via follower read: false
    --- FAIL: TestMultiRegionDataDriven/global_tables (26.23s)
Help

See also: How To Investigate a Go Test Failure (internal)
Parameters in this failure:

  • TAGS=bazel,gss

Same failure on other branches

This test on roachdash | Improve this report!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
branch-release-22.1 Used to mark GA and release blockers, technical advisories, and bugs for 22.1 C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants