Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

roachtest: clearrange/checks=true failed #80043

Closed
cockroach-teamcity opened this issue Apr 16, 2022 · 1 comment
Closed

roachtest: clearrange/checks=true failed #80043

cockroach-teamcity opened this issue Apr 16, 2022 · 1 comment
Assignees
Labels
C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-storage Storage Team X-duplicate Closed as a duplicate of another issue.
Milestone

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Apr 16, 2022

roachtest.clearrange/checks=true failed with artifacts on release-21.1 @ b0897408a939f45c338bef8f9b126cc559d2c2c6:

		  |   118.0s        0         2751.1         2815.2     10.5     23.1     39.8     58.7 write
		  |   119.0s        0         3132.0         2817.8      9.4     21.0     33.6     46.1 write
		  |   120.0s        0         3296.8         2821.8      9.4     17.8     29.4     44.0 write
		  | _elapsed___errors__ops/sec(inst)___ops/sec(cum)__p50(ms)__p95(ms)__p99(ms)_pMax(ms)
		  |   121.0s        0         3178.7         2824.8      9.4     21.0     30.4     44.0 write
		  |   122.0s        0         2961.5         2825.9     10.0     22.0     31.5     46.1 write
		  |   123.0s        0         2794.8         2825.6     11.0     23.1     32.5     48.2 write
		  |   124.0s        0         2937.6         2826.5     10.0     23.1     35.7     75.5 write
		  |   125.0s        0         3371.3         2830.9      8.9     19.9     33.6    113.2 write
		  |   126.0s        0         3585.2         2836.9      8.1     17.8     31.5    100.7 write
		  |   127.0s        0         3385.8         2841.2      8.9     21.0     30.4     46.1 write
		  |   128.0s        0         3273.1         2844.6      8.9     23.1     31.5     62.9 write
		  |   129.0s        0         3596.8         2850.4      8.1     18.9     32.5    130.0 write
		  |   130.0s        0         1570.0         2840.6      6.3     15.7     29.4     39.8 write
		  | Error: ERROR: result is ambiguous (unable to determine whether command was applied via snapshot) (SQLSTATE 40003)
		  | COMMAND_PROBLEM: exit status 1
		Wraps: (4) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *main.withCommandDetails (4) *exec.ExitError

	cluster.go:2688,clearrange.go:187,clearrange.go:34,test_runner.go:733: monitor failure: monitor task failed: t.Fatal() was called
		(1) attached stack trace
		  -- stack trace:
		  | main.(*monitor).WaitE
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2676
		  | main.(*monitor).Wait
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2684
		  | main.runClearRange
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/clearrange.go:187
		  | main.registerClearRange.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/clearrange.go:34
		  | main.(*testRunner).runTest.func2
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:733
		Wraps: (2) monitor failure
		Wraps: (3) attached stack trace
		  -- stack trace:
		  | main.(*monitor).wait.func2
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2732
		Wraps: (4) monitor task failed
		Wraps: (5) attached stack trace
		  -- stack trace:
		  | main.init
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2646
		  | runtime.doInit
		  | 	/usr/local/go/src/runtime/proc.go:6498
		  | runtime.main
		  | 	/usr/local/go/src/runtime/proc.go:238
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1581
		Wraps: (6) t.Fatal() was called
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *withstack.withStack (6) *errutil.leafError
Reproduce

To reproduce, try:

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh clearrange/checks=true

Same failure on other branches

/cc @cockroachdb/storage

This test on roachdash | Improve this report!

Jira issue: CRDB-15658

@cockroach-teamcity cockroach-teamcity added branch-release-21.1 C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. labels Apr 16, 2022
@cockroach-teamcity cockroach-teamcity added this to the 21.1 milestone Apr 16, 2022
@blathers-crl blathers-crl bot added the T-storage Storage Team label Apr 16, 2022
@nicktrav
Copy link
Collaborator

Same as #71509. Benign. Closing.

@nicktrav nicktrav added the X-duplicate Closed as a duplicate of another issue. label Dec 12, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-storage Storage Team X-duplicate Closed as a duplicate of another issue.
Projects
None yet
Development

No branches or pull requests

3 participants