【 使用环境 】测试环境
【 OB or 其他组件 】
libobclient-2.0.1-3.el7.x86_64.rpm
obclient-2.0.1-2.el7.x86_64.rpm
ob-deploy-1.3.3-11.el7.x86_64.rpm
obproxy-ce-3.2.3-2.el7.x86_64.rpm
oceanbase-ce-3.1.3-10100032022041510.el7.x86_64.rpm
oceanbase-ce-libs-3.1.3-10100032022041510.el7.x86_64.rpm
【 使用版本 】
【问题描述】
通过obproxy2883端口可以正常连接集群，但是执行启动或者reload命令无法正常显示
【复现路径】
obproxy：xx.xx.xx.124
observer：xx.xx.xx.112 xx.xx.xx.113 xx.xx.xx.129
之前可以正常启动，按照社区里的一篇帖子处理observer_sys_password与proxyro密码不一致的问题，改完之后就无法reload了，改回来以后也不行
执行obd cluster stop后再次启动就提示Failed to connect obproxy-ce，但是通过obproxy2883却能正常连接，整个过程如下：
[root@test-manager log]# obd cluster start obdora
[ERROR] Deploy need reload.
Use `obd cluster reload obdora` to make changes take effect.
If you still need to start the cluster, use the `obd cluster start obdora --wop` option to start the cluster without loading parameters.
See https://open.oceanbase.com/docs/obd-cn/V1.3.0/10000000000099584.
[root@test-manager log]# obd cluster start obdora --wop
Get local repositories and plugins ok
Open ssh connection ok
Load cluster param plugin ok
Check before start observer ok
Check before start obproxy ok
Start observer ok
observer program health check ok
Connect to observer ok
Wait for observer init ok
+------------------------------------------------+
| observer |
+--------------+---------+------+-------+--------+
| ip | version | port | zone | status |
+--------------+---------+------+-------+--------+
| xx.xx.xx.112 | 3.1.3 | 2881 | zone1 | active |
| xx.xx.xx.113 | 3.1.3 | 2881 | zone2 | active |
| xx.xx.xx.129 | 3.1.3 | 2881 | zone3 | active |
+--------------+---------+------+-------+--------+
Start obproxy ok
obproxy program health check ok
Connect to obproxy x
[ERROR] Failed to connect obproxy-ce
See https://open.oceanbase.com/docs/obd-cn/V1.3.0/10000000000099584.
[root@test-manager log]# obclient -h xx.xx.xx.124 -P2883 -uroot -p
Enter password:
Welcome to the OceanBase. Commands end with ; or \g.
Your MySQL connection id is 11
Server version: 5.6.25 OceanBase 3.1.3 (r10100032022041510-a09d3134c10665f03fd56d7f8bdd413b2b771977) (Built Apr 15 2022 02:16:22)
Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
MySQL [(none)]> exit
Bye
obproxy.log日志如下
[2022-07-06 16:12:19.685099] WARN [PROXY.CS] is_authorised_proxysys (ob_mysql_client_session.cpp:1427) [25134][Y0-7F477E8383A0] [lt=8] [dc=0] root@proxysys check failed(ret=-4043)
[2022-07-06 16:12:19.685119] WARN [PROXY.SM] analyze_login_request (ob_mysql_sm.cpp:2111) [25134][Y0-7F477E8383A0] [lt=20] [dc=0] fail to check user identity(sm_id=26, ret=-4042)
[2022-07-06 16:12:19.685133] INFO [PROXY.SM] ob_mysql_sm.cpp:2159 [25134][Y0-7F477E8383A0] [lt=7] [dc=0] client login audit(client_addr={xx.xx.xx.124:38860}, hsr.cluster_name_=obcluster, hsr.tenant_name_=proxysys, hsr.user_name_=root, status="failed")
[2022-07-06 16:12:19.685151] WARN [PROXY.SM] analyze_mysql_request (ob_mysql_sm.cpp:1986) [25134][Y0-7F477E8383A0] [lt=18] [dc=0] fail to analyze login request(ret=-4042)
[2022-07-06 16:12:19.685157] WARN [PROXY.SM] state_client_request_read (ob_mysql_sm.cpp:641) [25134][Y0-7F477E8383A0] [lt=5] [dc=0] error parsing client request(ret=-4016, sm_id=26)
[2022-07-06 16:12:19.685163] WARN [PROXY.SM] set_client_abort (ob_mysql_sm.cpp:6343) [25134][Y0-7F477E8383A0] [lt=4] [dc=0] client will abort soon(sm_id=26, cs_id=3145737, proxy_sessid=0, ss_id=0, server_sessid=0, client_ip={xx.xx.xx.124:38860}, server_ip={*Not IP address [0]*:0}, cluster_name=, tenant_name=, user_name=, db=, event="VC_EVENT_READ_READY", request_cmd="Sleep", sql_cmd="Login", sql=OB_MYSQL_COM_LOGIN)
[2022-07-06 16:12:19.685183] INFO [PROXY.TXN] ob_mysql_transact.cpp:78 [25134][Y0-7F477E8383A0] [lt=6] [dc=0] [ObMysqlTransact::bad_request] parser marked request bad
[2022-07-06 16:12:19.685189] INFO [PROXY.SM] ob_mysql_sm.cpp:7223 [25134][Y0-7F477E8383A0] [lt=3] [dc=0] INTERNAL_ERROR, will disconnect(sm_id=26)
[2022-07-06 16:12:19.685212] INFO [PROXY.CS] ob_mysql_client_session.cpp:91 [25134][Y0-7F477E8383A0] [lt=3] [dc=0] client session destroy(cs_id=3145737, proxy_sessid=0, client_vc=NULL)
[2022-07-06 16:12:19.685235] INFO [PROXY.SM] ob_mysql_sm.cpp:7696 [25134][Y0-7F477E8383A0] [lt=13] [dc=0] deallocating sm(sm_id=26)
[2022-07-06 16:12:22.689038] INFO [PROXY.SOCK] ob_connection.cpp:367 [25146][Y0-0] [lt=55] [dc=0] connection accepted(client={xx.xx.xx.124:38862}, server={0.0.0.0:2883}, accepted_fd=46, listen_fd=41)
[2022-07-06 16:12:22.689114] INFO [PROXY.NET] ob_mysql_session_accept.cpp:36 [25134][Y0-7F477EC3A2A0] [lt=2] [dc=0] [ObMysqlSessionAccept:main_event] accepted connection(netvc=0x7f477ec33a30, client_ip={xx.xx.xx.124:38862})
[2022-07-06 16:12:22.689167] INFO [PROXY.CS] ob_mysql_client_session.cpp:363 [25134][Y0-7F477EC3A2A0] [lt=29] [dc=0] client session born(cs_id=3145738, proxy_sessid=0, is_local_connection=false, client_vc=0x7f477ec33a30, client_fd=46, client_addr="xx.xx.xx.124:38862")
[2022-07-06 16:12:22.689192] INFO [PROXY.CS] ob_mysql_client_session.cpp:234 [25134][Y0-7F477EC3A2A0] [lt=13] [dc=0] Starting new transaction using sm(cs_id=3145738, get_transact_count()=0, sm_id=27)
[2022-07-06 16:12:22.689203] INFO [PROXY.SM] ob_mysql_sm.cpp:474 [25134][Y0-7F477EC3A2A0] [lt=6] [dc=0] the request already in buffer, continue to handle it(buffer len=0, is_auth_rquest=true)
[2022-07-06 16:12:22.689451] WARN [PROXY.CS] is_authorised_proxysys (ob_mysql_client_session.cpp:1427) [25134][Y0-7F477EC3A2A0] [lt=16] [dc=0] root@proxysys check failed(ret=-4043)
[2022-07-06 16:12:22.689472] WARN [PROXY.SM] analyze_login_request (ob_mysql_sm.cpp:2111) [25134][Y0-7F477EC3A2A0] [lt=20] [dc=0] fail to check user identity(sm_id=27, ret=-4042)
[2022-07-06 16:12:22.689485] INFO [PROXY.SM] ob_mysql_sm.cpp:2159 [25134][Y0-7F477EC3A2A0] [lt=6] [dc=0] client login audit(client_addr={xx.xx.xx.124:38862}, hsr.cluster_name_=obcluster, hsr.tenant_name_=proxysys, hsr.user_name_=root, status="failed")
[2022-07-06 16:12:22.689493] WARN [PROXY.SM] analyze_mysql_request (ob_mysql_sm.cpp:1986) [25134][Y0-7F477EC3A2A0] [lt=7] [dc=0] fail to analyze login request(ret=-4042)
[2022-07-06 16:12:22.689498] WARN [PROXY.SM] state_client_request_read (ob_mysql_sm.cpp:641) [25134][Y0-7F477EC3A2A0] [lt=4] [dc=0] error parsing client request(ret=-4016, sm_id=27)
[2022-07-06 16:12:22.689509] WARN [PROXY.SM] set_client_abort (ob_mysql_sm.cpp:6343) [25134][Y0-7F477EC3A2A0] [lt=9] [dc=0] client will abort soon(sm_id=27, cs_id=3145738, proxy_sessid=0, ss_id=0, server_sessid=0, client_ip={xx.xx.xx.124:38862}, server_ip={*Not IP address [0]*:0}, cluster_name=, tenant_name=, user_name=, db=, event="VC_EVENT_READ_READY", request_cmd="Sleep", sql_cmd="Login", sql=OB_MYSQL_COM_LOGIN)
[2022-07-06 16:12:22.689529] INFO [PROXY.TXN] ob_mysql_transact.cpp:78 [25134][Y0-7F477EC3A2A0] [lt=6] [dc=0] [ObMysqlTransact::bad_request] parser marked request bad
[2022-07-06 16:12:22.689535] INFO [PROXY.SM] ob_mysql_sm.cpp:7223 [25134][Y0-7F477EC3A2A0] [lt=3] [dc=0] INTERNAL_ERROR, will disconnect(sm_id=27)
[2022-07-06 16:12:22.689572] INFO [PROXY.CS] ob_mysql_client_session.cpp:91 [25134][Y0-7F477EC3A2A0] [lt=3] [dc=0] client session destroy(cs_id=3145738, proxy_sessid=0, client_vc=NULL)
[2022-07-06 16:12:22.689591] INFO [PROXY.SM] ob_mysql_sm.cpp:7696 [25134][Y0-7F477EC3A2A0] [lt=9] [dc=0] deallocating sm(sm_id=27)
【问题现象及影响】
【附件】