【 使用环境 】测试环境
【 OB or 其他组件 】OB
【 使用版本 】4.2.1.0-100000102023092807 计划升级至最新的版本4.2.1.BP6时报异常
【问题描述】清晰明确描述问题
【复现路径】问题出现前后相关操作
【附件及日志】
一下为报错日志
2024-06-03 16:55:10.497 ERROR 54383 — [pool-manual-subtask-executor14,2aa5e462d52e4eca,c230deb592bc] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] init ob connector timeout, connectProperties=ConnectProperties(connectionMode=direct, address=172.16.103.165, port=2881, obsAddrList=null, username=root, tenantName=sys, clusterName=null, obClusterId=null, proxy=null, odpSocketConfig=null, vpcId=1
2024-06-03 16:54:58.375 INFO 54383 — [pool-host-check-host-status5,01ba79305fac4653,a244b0df3103] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://172.16.103.165:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_mgragent, skipPorts=false), params:null
2024-06-03 16:54:58.407 INFO 54383 — [ForkJoinPool-186535-worker-4,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=false, cluster=ObClusterOverview(id=4, name=obuat, obClusterId=3, vpcId=1, vpcName=system-default, type=PRIMARY, status=UPGRADING, origin=CREATED, syncStatus=VALID, rootserverJson={“ObCluster”:“obuat”,“ObClusterId”:3,“ObRegion”:“obuat”,“ObRegionId”:3,“ReadonlyRsList”:[],“RsList”:[{“address”:“172.16.103.165:2882”,“role”:“LEADER”,“sql_port”:2881},{“address”:“172.16.103.196:2882”,“role”:“FOLLOWER”,“sql_port”:2881},{“address”:“172.16.103.202:2882”,“role”:“FOLLOWER”,“sql_port”:2881}],“Type”:“PRIMARY”,“timestamp”:1717404593744000}, createTime=2023-06-09T16:02:32+08:00, creator=admin, obVersion=4.2.1.0, tenantCount=12)
2024-06-03 16:54:58.447 INFO 54383 — [pool-host-check-host-status5,01ba79305fac4653,a244b0df3103] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://172.16.103.165:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_monagent, skipPorts=false), params:null
2024-06-03 16:54:58.513 INFO 54383 — [pool-host-check-host-status5,01ba79305fac4653,a244b0df3103] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://172.16.103.165:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=ocp_agentd, skipPorts=false), params:null
2024-06-03 16:55:01.135 INFO 54383 — [ForkJoinPool-16-worker-17,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://172.16.103.165:62889/api/v1/log/alarms, params:null
2024-06-03 16:55:07.493 INFO 54383 — [pool-manual-subtask-executor14,2aa5e462d52e4eca,c230deb592bc] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=null, obClusterId=null, tenantName=sys, username=root, address=172.16.103.165, port=2881, database=oceanbase)
2024-06-03 16:55:07.495 INFO 54383 — [pool-manual-subtask-executor14,2aa5e462d52e4eca,c230deb592bc] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] create new ob connector, connectProperties=ConnectProperties(connectionMode=direct, address=172.16.103.165, port=2881, obsAddrList=null, username=root, tenantName=sys, clusterName=null, obClusterId=null, proxy=null, odpSocketConfig=null, vpcId=1, compatibilityMode=MYSQL, database=oceanbase)
2024-06-03 16:55:10.497 ERROR 54383 — [pool-manual-subtask-executor14,2aa5e462d52e4eca,c230deb592bc] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] init ob connector timeout, connectProperties=ConnectProperties(connectionMode=direct, address=172.16.103.165, port=2881, obsAddrList=null, username=root, tenantName=sys, clusterName=null, obClusterId=null, proxy=null, odpSocketConfig=null, vpcId=1, compatibilityMode=MYSQL, database=oceanbase), initTimeoutMillis=3000
2024-06-03 16:55:10.500 ERROR 54383 — [pool-manual-subtask-executor14,2aa5e462d52e4eca,c230deb592bc] c.o.ocp.core.util.ExceptionUtils : Checked Exception: com.oceanbase.ocp.core.exception.UnexpectedException occurred with code error.ob.cluster.server.connect.failed, and args [obuat, 3, 172.16.103.165]
2024-06-03 16:55:10.502 ERROR 54383 — [pool-manual-subtask-executor14,2aa5e462d52e4eca,c230deb592bc] c.o.o.c.t.e.c.w.subtask.SubtaskExecutor : Failed to connect to Cluster obuat:3 via observer 172.16.103.165
com.oceanbase.ocp.core.exception.UnexpectedException: [OCP UnexpectedException]: status=500 INTERNAL_SERVER_ERROR, errorCode=OB_CLUSTER_SERVER_CONNECT_FAILED, args=obuat,3,172.16.103.165
2024-06-03 16:55:11.084 INFO 54383 — [http-nio-0.0.0.0-8080-exec-7,b99396015fcc4c49,29301384bab8] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /services?User_ID=alibaba&UID=test&Action=GetObProxyConfig&ObproxyClusterName=uatproxy&VersionOnly=true, client=172.16.103.165, traceId=b99396015fcc4c49, method=CommonResult com.oceanbase.ocp.server.common.controllerv22.OcpControllerConfig.getObProxyConfig(String,String,String,String,boolean), args=alibaba,test,uatproxy,true,]
2024-06-03 16:55:11.088 INFO 54383 — [http-nio-0.0.0.0-8080-exec-7,b99396015fcc4c49,29301384bab8] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /services client=172.16.103.165, traceId=b99396015fcc4c49, duration=5 ms]
2024-06-03 16:55:11.296 INFO 54383 — [pool-Check obproxy5,6c4229c22cbe4238,488abb04db28] c.o.o.s.o.SystemOdpOperatorFactory : connect obproxy 172.16.103.165 2883
obd日志麻烦提供下 （~/.obd/log/obd日志）