Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Haproxy fails to start 1.15.0 #1825

Open
71g3pf4c3 opened this issue Sep 23, 2024 · 1 comment
Open

Haproxy fails to start 1.15.0 #1825

71g3pf4c3 opened this issue Sep 23, 2024 · 1 comment
Labels

Comments

@71g3pf4c3
Copy link

71g3pf4c3 commented Sep 23, 2024

Report

Haproxy fails to start with default installation manifests in kind cluster
https://github.com/percona/percona-xtradb-cluster-operator/blob/v1.15.0/deploy/cr-minimal.yaml
https://github.com/percona/percona-xtradb-cluster-operator/blob/v1.15.0/deploy/cr.yaml
In logs server_name is NOSRV, probably issues with haproxy.
pxc-monit

More about the problem

Haproxy log snippet:

2024-09-23T13:17:50.216928556Z backend galera-mysqlx-nodes has no server available!
2024-09-23T13:17:55.227011398Z {"time":"23/Sep/2024:13:17:55.226", "client_ip": "127.0.0.1", "client_port":"37676", "backend_source_ip": "-", "backend_source_port": "-", "frontend_name": "galera-admin-i
n", "backend_name": "galera-admin-nodes", "server_name":"<NOSRV>", "tw": "-1", "tc": "-1", "Tt": "0", "bytes_read": "0", "termination_state": "SC", "actconn": "1", "feconn" :"1", "beconn": "0", "srv_con
n": "0", "retries": "0", "srv_queue": "0", "backend_queue": "0" }
2024-09-23T13:18:00.208381308Z {"time":"23/Sep/2024:13:18:00.208", "client_ip": "127.0.0.1", "client_port":"42292", "backend_source_ip": "-", "backend_source_port": "-", "frontend_name": "galera-admin-i
n", "backend_name": "galera-admin-nodes", "server_name":"<NOSRV>", "tw": "-1", "tc": "-1", "Tt": "0", "bytes_read": "0", "termination_state": "SC", "actconn": "1", "feconn" :"1", "beconn": "0", "srv_con
n": "0", "retries": "0", "srv_queue": "0", "backend_queue": "0" }
2024-09-23T13:18:02.725607593Z [WARNING]  (16) : kill 41
2024-09-23T13:18:05.208230901Z {"time":"23/Sep/2024:13:18:05.208", "client_ip": "127.0.0.1", "client_port":"42308", "backend_source_ip": "-", "backend_source_port": "-", "frontend_name": "galera-admin-i
n", "backend_name": "galera-admin-nodes", "server_name":"<NOSRV>", "tw": "-1", "tc": "-1", "Tt": "0", "bytes_read": "0", "termination_state": "SC", "actconn": "1", "feconn" :"1", "beconn": "0", "srv_con
n": "0", "retries": "0", "srv_queue": "0", "backend_queue": "0" }

pxc-monit logs snippet:

2024-09-23T11:43:01.436935675Z now [cluster1-pxc-0.cluster1-pxc.default.svc.cluster.local]
2024-09-23T11:43:01.436937850Z 2024/09/23 11:43:01 execing: /opt/percona/haproxy_add_pxc_nodes.sh with stdin: cluster1-pxc-0.cluster1-pxc.default.svc.cluster.local
2024-09-23T11:43:01.561615843Z 2024/09/23 11:43:01 {"time":"23/Sep/2024:11:43:01.441", "message": "Running /opt/percona/haproxy_add_pxc_nodes.sh"}
2024-09-23T11:43:01.561627802Z {"time":"23/Sep/2024:11:43:01.448", "message": "number of available nodes are 1"}
2024-09-23T11:43:01.561631193Z Configuration file is valid
2024-09-23T11:43:01.561634070Z {"time":"23/Sep/2024:11:43:01.529", "backend_source_ip": "cluster1-pxc-0.cluster1-pxc.default.svc.cluster.local", "backend_source_port": "33062", "message": "The following
 values are used for PXC node cluster1-pxc-0.cluster1-pxc.default.svc.cluster.local in backend : wsrep_local_state is 4; pxc_maint_mod is DISABLED; wsrep_cluster_status is Primary; wsrep_reject_queries
is NONE; wsrep_sst_donor_rejects_queries is OFF; 1 nodes are available"}
2024-09-23T11:43:01.561637929Z {"time":"23/Sep/2024:11:43:01.531", "backend_source_ip": "cluster1-pxc-0.cluster1-pxc.default.svc.cluster.local", "backend_source_port": "33062", "message": "PXC node clus
ter1-pxc-0.cluster1-pxc.default.svc.cluster.local for backend  is ok"}
2024-09-23T11:43:01.561640841Z {"time":"23/Sep/2024:11:43:01.532", "message": "reload | socat stdio /etc/haproxy/pxc/haproxy-main.sock"}
2024-09-23T11:43:01.561642910Z Success=1
2024-09-23T11:43:01.561644963Z --
2024-09-23T11:43:01.561647167Z [NOTICE]   (1) : New worker (173) forked
2024-09-23T11:43:01.561649694Z [NOTICE]   (1) : Loading success.
2024-09-23T11:43:01.561652219Z [NOTICE]   (1) : haproxy version is 2.8.5
2024-09-23T11:43:01.561654945Z [NOTICE]   (1) : path to executable is /usr/sbin/haproxy
2024-09-23T11:43:01.561657001Z [WARNING]  (1) : Former worker (149) exited with code 0 (Exit)

Steps to reproduce

  1. Install kind
  2. Install pxc-operator
  3. Apply https://github.com/percona/percona-xtradb-cluster-operator/blob/v1.15.0/deploy/cr-minimal.yaml or https://github.com/percona/percona-xtradb-cluster-operator/blob/v1.15.0/deploy/cr.yaml
    manifests

Versions

  1. Kubernetes 1,29,2 (kind)
  2. Operator 1.15.0
  3. Database percona/percona-xtradb-cluster:8.0.36-28.1

Anything else?

No response

@71g3pf4c3 71g3pf4c3 added the bug label Sep 23, 2024
@71g3pf4c3 71g3pf4c3 changed the title Haproxy Haproxy fails to start 1.15.0 Sep 23, 2024
@hors
Copy link
Collaborator

hors commented Sep 24, 2024

hi @71g3pf4c3, we do not support kind officially. The SC error flag means that the network or the server refused the connection. I can't reproduce this issue using supported platforms. So, try to check network configuration.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants