Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

roachtest: clearrange/checks=true failed #65251

Closed
cockroach-teamcity opened this issue May 14, 2021 · 0 comments
Closed

roachtest: clearrange/checks=true failed #65251

cockroach-teamcity opened this issue May 14, 2021 · 0 comments
Labels
C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked.
Milestone

Comments

@cockroach-teamcity
Copy link
Member

roachtest.clearrange/checks=true failed with artifacts on release-21.1 @ 8fecaf91b33f63780880f9b0fd715e15ceecede8:

		  |   |   exit 1
		  |   | fi
		  |   |
		  |   | if systemctl is-active -q cockroach; then
		  |   |   echo "cockroach service already active"
		  |   | 	echo "To get more information: systemctl status cockroach"
		  |   | 	exit 1
		  |   | fi
		  |   |
		  |   | # If cockroach failed, the service still exists; we need to clean it up before
		  |   | # we can start it again.
		  |   | sudo systemctl reset-failed cockroach 2>/dev/null || true
		  |   |
		  |   | # The first time we run, install a small script that shows some helpful
		  |   | # information when we ssh in.
		  |   | if [ ! -e ${HOME}/.profile-cockroach ]; then
		  |   |   cat > ${HOME}/.profile-cockroach <<'EOQ'
		  |   | echo ""
		  |   | if systemctl is-active -q cockroach; then
		  |   | 	echo "cockroach is running; see: systemctl status cockroach"
		  |   | elif systemctl is-failed -q cockroach; then
		  |   | 	echo "cockroach stopped; see: systemctl status cockroach"
		  |   | else
		  |   | 	echo "cockroach not started"
		  |   | fi
		  |   | echo ""
		  |   | EOQ
		  |   |   echo ". ${HOME}/.profile-cockroach" >> ${HOME}/.profile
		  |   | fi
		  |   |
		  |   | # We run this script (with arg "run") as a service unit. We do not use --user
		  |   | # because memory limiting doesn't work in that mode. Instead we pass the uid and
		  |   | # gid that the process will run under.
		  |   | # The "notify" service type means that systemd-run waits until cockroach
		  |   | # notifies systemd that it is ready; NotifyAccess=all is needed because this
		  |   | # notification doesn't come from the main PID (which is bash).
		  |   | sudo systemd-run --unit cockroach \
		  |   |   --same-dir --uid $(id -u) --gid $(id -g) \
		  |   |   --service-type=notify -p NotifyAccess=all \
		  |   |   -p MemoryMax=95% \
		  |   |   -p LimitCORE=infinity \
		  |   |   -p LimitNOFILE=65536 \
		  |   | 	bash $0 run
		  |   | EOF
		  |   | systemd-run: unrecognized option '--same-dir'
		  | Wraps: (3) exit status 1
		  | Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *exec.ExitError: 
		  | I210514 19:30:11.682557 1 (gostd) cluster_synced.go:1744  [-] 1  command failed
		Wraps: (2) exit status 1
		Error types: (1) *main.withCommandDetails (2) *exec.ExitError
Reproduce

To reproduce, try:

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh clearrange/checks=true

Same failure on other branches

/cc @cockroachdb/storage

This test on roachdash | Improve this report!

@cockroach-teamcity cockroach-teamcity added branch-release-21.1 C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. labels May 14, 2021
@cockroach-teamcity cockroach-teamcity added this to the 21.1 milestone May 14, 2021
@tbg tbg closed this as completed May 14, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked.
Projects
None yet
Development

No branches or pull requests

2 participants