集群扩容，切换租户到新服务器，应用报错连不上数据库

OceanBase 技术问题
#1

【 使用环境 】生产环境
【 OB or 其他组件 】odp 、observer
【 使用版本 】odp-4.2.1.0-11 、OceanBase 构建版本号：4.2.5.1-101000092024120918
【问题描述】集群 3-3-3 ，扩容 3台物理机，迁移租户到新物理机
【复现路径】问题出现前后相关操作
【附件及日志】推荐使用OceanBase敏捷诊断工具obdiag收集诊断信息,详情参见链接（右键跳转查看）：

【SOP系列 22 】——故障诊断第一步(自助诊断和诊断信息收集)

【备注】基于 LLM 和开源文档 RAG 的论坛小助手已开放测试，在发帖时输入 [@论坛小助手] 即可召唤小助手，欢迎试用！
应用报错信息：


2026-03-17 21:18:29.964  INFO 1 --- [kExecutor-77906] c.c.hippo.task.print.PrintExecutor       : ====> print executor print. ip:10.145.70.27 port:9100

2026-03-17 21:18:47.456  INFO 1 --- [kExecutor-77839] c.c.hippo.task.print.PrintExecutor       : ====> print executor print. ip:10.145.70.36 port:9100

2026-03-17 21:18:53.984  INFO 1 --- [kExecutor-77907] c.c.hippo.task.print.PrintExecutor       : ====> print executor print. ip:10.145.70.36 port:9100

2026-03-17 21:18:55.349  INFO 1 --- [kExecutor-77908] c.c.hippo.task.print.PrintExecutor       : ====> print executor print. ip:10.145.35.26 port:9100

2026-03-17 21:18:57.966  INFO 1 --- [kExecutor-77840] c.c.hippo.task.print.PrintExecutor       : ====> print executor print. ip:10.145.70.136 port:9100

2026-03-17 21:19:01.636 ERROR 1 --- [ XNIO-1 task-32] c.a.druid.pool.DruidPooledStatement      : CommunicationsException, druid version 1.1.23, jdbcUrl : jdbc:mysql://dbcloud-ce-jc.catl.com:2883/microservice?useSSL=false, testWhileIdle true, idle millis 3013, minIdle 50, poolingCount 3, timeBetweenEvictionRunsMillis 60000, lastValidIdleMillis 3013, driver com.mysql.jdbc.Driver, exceptionSorter com.alibaba.druid.pool.vendor.MySqlExceptionSorter



	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[na:1.8.0_202]

	at com.alibaba.druid.filter.FilterEventAdapter.preparedStatement_execute(FilterEventAdapter.java:440) ~[druid-1.1.23.jar!/:1.1.23]

com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure

	at com.mysql.jdbc.PreparedStatement.execute(PreparedStatement.java:1242) ~[mysql-connector-java-5.1.47.jar!/:5.1.47]



	at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[na:1.8.0_202]

	at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2495) ~[mysql-connector-java-5.1.47.jar!/:5.1.47]

	at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2683) ~[mysql-connector-java-5.1.47.jar!/:5.1.47]

	at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3905) ~[mysql-connector-java-5.1.47.jar!/:5.1.47]

	at org.apache.ibatis.executor.statement.RoutingStatementHandler.query(RoutingStatementHandler.java:79) [mybatis-3.5.3.jar!/:3.5.3]

	at org.apache.ibatis.executor.BaseExecutor.queryFromDatabase(BaseExecutor.java:324) [mybatis-3.5.3.jar!/:3.5.3]

	at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1903) ~[mysql-connector-java-5.1.47.jar!/:5.1.47]

	at com.alibaba.druid.filter.FilterChainImpl.preparedStatement_execute(FilterChainImpl.java:3461) ~[druid-1.1.23.jar!/:1.1.23]

	at com.alibaba.druid.filter.FilterChainImpl.preparedStatement_execute(FilterChainImpl.java:3459) ~[druid-1.1.23.jar!/:1.1.23]

2026-03-17 21:19:01.750 ERROR 1 --- [ XNIO-1 task-32] com.alibaba.druid.pool.DruidDataSource   : discard connection

	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[na:1.8.0_202]

	at com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:990) ~[mysql-connector-java-5.1.47.jar!/:5.1.47]

The last packet successfully received from the server was 3,012 milliseconds ago.  The last packet sent successfully to the server was 338 milliseconds ago.

	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[na:1.8.0_202]

	at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:3562) ~[mysql-connector-java-5.1.47.jar!/:5.1.47]

	at com.alibaba.druid.pool.DruidPooledPreparedStatement.execute(DruidPooledPreparedStatement.java:497) ~[druid-1.1.23.jar!/:1.1.23]

	at org.apache.ibatis.executor.statement.PreparedStatementHandler.query(PreparedStatementHandler.java:64) [mybatis-3.5.3.jar!/:3.5.3]

	at com.mysql.jdbc.Util.handleNewInstance(Util.java:425) ~[mysql-connector-java-5.1.47.jar!/:5.1.47]

	at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:3462) ~[mysql-connector-java-5.1.47.jar!/:5.1.47]

	at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2530) ~[mysql-connector-java-5.1.47.jar!/:5.1.47]

	at com.alibaba.druid.proxy.jdbc.PreparedStatementProxyImpl.execute(PreparedStatementProxyImpl.java:167) ~[druid-1.1.23.jar!/:1.1.23]

	at org.apache.ibatis.executor.SimpleExecutor.doQuery(SimpleExecutor.java:63) [mybatis-3.5.3.jar!/:3.5.3]

	at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:426) [mybatis-spring-2.0.3.jar!/:2.0.3]

	at org.mybatis.spring.SqlSessionTemplate.selectOne(SqlSessionTemplate.java:159) [mybatis-spring-2.0.3.jar!/:2.0.3]

	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_202]

	at com.catlbattery.hippo.role.$Proxy124.selectByUserId(Unknown Source) [na:3.8.6]

	at org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(HiddenHttpMethodFilter.java:94) [spring-web-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:830) [undertow-core-2.0.26.Final.jar!/:2.0.26.Final]

	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_202]

	at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:104) [spring-boot-actuator-2.1.9.RELEASE.jar!/:2.1.9.RELEASE]

	at java.lang.Thread.run(Thread.java:813) [na:1.8.0_202]

	at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) [spring-web-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at io.undertow.servlet.handlers.ServletChain$1.handleRequest(ServletChain.java:68) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:3014) ~[mysql-connector-java-5.1.47.jar!/:5.1.47]

	at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:3472) ~[mysql-connector-java-5.1.47.jar!/:5.1.47]

	at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:685) [spring-aop-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334) [spring-security-web-5.1.6.RELEASE.jar!/:5.1.6.RELEASE]

	at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334) [spring-security-web-5.1.6.RELEASE.jar!/:5.1.6.RELEASE]

	at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334) [spring-security-web-5.1.6.RELEASE.jar!/:5.1.6.RELEASE]

	at io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:249) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) [spring-web-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:130) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:109) [mybatis-3.5.3.jar!/:3.5.3]

	at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:147) [mybatis-3.5.3.jar!/:3.5.3]

	at org.apache.ibatis.session.defaults.DefaultSqlSession.selectOne(DefaultSqlSession.java:76) [mybatis-3.5.3.jar!/:3.5.3]

	at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_202]

	at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:139) [spring-tx-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at com.catlbattery.hippo.role.RoleService$$FastClassBySpringCGLIB$$1127054b.invoke(<generated>) [classes!/:3.8.6]

	at com.catlbattery.hippo.role.RoleService$$EnhancerBySpringCGLIB$$cf929223.getRoleByUserId(<generated>) [classes!/:3.8.6]

	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at com.catlbattery.hippo.support.auth.AbstractAuthenticationFilter.doFilterInternal(AbstractAuthenticationFilter.java:43) [classes!/:3.8.6]

	at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) [spring-web-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at io.undertow.servlet.handlers.RedirectDirHandler.handleRequest(RedirectDirHandler.java:68) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60) [undertow-core-2.0.26.Final.jar!/:2.0.26.Final]

	at io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:78) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:178) [spring-security-web-5.1.6.RELEASE.jar!/:5.1.6.RELEASE]

	at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334) [spring-security-web-5.1.6.RELEASE.jar!/:5.1.6.RELEASE]

	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334) [spring-security-web-5.1.6.RELEASE.jar!/:5.1.6.RELEASE]

	... 124 common frames omitted

	at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:93) [mybatis-3.5.3.jar!/:3.5.3]

	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) [spring-web-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:140) [mybatis-3.5.3.jar!/:3.5.3]

	at com.sun.proxy.$Proxy115.selectOne(Unknown Source) [na:na]

	at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_202]

	at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) [spring-aop-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:105) [spring-security-web-5.1.6.RELEASE.jar!/:5.1.6.RELEASE]

	at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:215) [spring-security-web-5.1.6.RELEASE.jar!/:5.1.6.RELEASE]

	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43) [undertow-core-2.0.26.Final.jar!/:2.0.26.Final]

	at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) [undertow-core-2.0.26.Final.jar!/:2.0.26.Final]

	at io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:133) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:83) [mybatis-3.5.3.jar!/:3.5.3]

	at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:343) [spring-aop-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) [spring-core-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at com.catlbattery.hippo.support.auth.AbstractAuthenticationProvider.getUserAuthorities(AbstractAuthenticationProvider.java:19) [classes!/:3.8.6]

	at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:116) [spring-security-web-5.1.6.RELEASE.jar!/:5.1.6.RELEASE]

	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334) [spring-security-web-5.1.6.RELEASE.jar!/:5.1.6.RELEASE]

	at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) [spring-web-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.filterAndRecordMetrics(WebMvcMetricsFilter.java:114) [spring-boot-actuator-2.1.9.RELEASE.jar!/:2.1.9.RELEASE]

	at io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:269) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at org.apache.ibatis.executor.BaseExecutor.query(BaseExecutor.java:156) [mybatis-3.5.3.jar!/:3.5.3]

	at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:78) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]



	at io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) [spring-aop-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) [undertow-core-2.0.26.Final.jar!/:2.0.26.Final]

Caused by: java.io.EOFException: Can not read response from server. Expected to read 4 bytes, read 0 bytes before connection was unexpectedly lost.

	at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [na:1.8.0_202]

	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:56) [spring-security-web-5.1.6.RELEASE.jar!/:5.1.6.RELEASE]

	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_202]

	at com.catlbattery.hippo.role.$Proxy125.selectByUserId(Unknown Source) [na:3.8.6]

	at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:334) [spring-security-web-5.1.6.RELEASE.jar!/:5.1.6.RELEASE]

	at org.springframework.web.filter.CorsFilter.doFilterInternal(CorsFilter.java:97) [spring-web-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:99) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at io.undertow.server.Connectors.executeRootHandler(Connectors.java:376) [undertow-core-2.0.26.Final.jar!/:2.0.26.Final]

	at sun.reflect.GeneratedMethodAccessor123.invoke(Unknown Source) ~[na:na]

	at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:87) [mybatis-3.5.3.jar!/:3.5.3]

	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) [spring-aop-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at com.catlbattery.hippo.role.RoleService.getRoleByUserId(RoleService.java:123) [classes!/:3.8.6]

	at org.springframework.security.authentication.ProviderManager.authenticate(ProviderManager.java:175) [spring-security-core-5.1.6.RELEASE.jar!/:5.1.6.RELEASE]

	at com.catlbattery.hippo.support.auth.AbstractAuthenticationFilter.doFilterInternal(AbstractAuthenticationFilter.java:62) [classes!/:3.8.6]

	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119) [spring-web-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:74) [spring-security-web-5.1.6.RELEASE.jar!/:5.1.6.RELEASE]

	at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:132) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43) [undertow-core-2.0.26.Final.jar!/:2.0.26.Final]

	at sun.reflect.GeneratedMethodAccessor137.invoke(Unknown Source) ~[na:na]

	at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198) [spring-aop-5.1.10.RELEASE.jar!/:5.1.10.RELEASE]

	at com.catlbattery.hippo.support.auth.system.SysAuthenticationProvider.authenticate(SysAuthenticationProvider.java:27) [classes!/:3.8.6]

	at io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:84) [undertow-servlet-2.0.26.Final.jar!/:2.0.26.Final]

	at io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46) [undertow-core-2.0.26.Final.jar!/:2.0.26.Final]

2026-03-17 21:19:01.752 ERROR 1 --- [eate--688119117] com.alibaba.druid.pool.DruidDataSource   : create connection SQLException, url: jdbc:mysql://dbcloud-ce-jc.catl.com:2883/microservice?useSSL=false, errorCode 0, state 08S01
5 个赞
#3

根因分析场景: 针对断链接场景的根因分析
根因分析命令: obdiag rca run --scene=disconnection
日志采集场景: 集群无法连接
日志采集命令: obdiag gather scene run --scene=observer.cluster_down

为了更好地帮助您定位问题，请您先使用上述命令收集相关信息，并将日志提供给我们。此外，还需要请您提供以下信息：

  1. 集群扩容的具体时间点是什么？
  2. 应用在尝试连接时使用的连接字符串是什么？
  3. 您是否在扩容前后修改过任何配置参数？
  4. 在扩容前，应用连接是否有过类似的问题？
  5. 集群当前的状态是什么样的？例如，所有节点是否都正常运行？
  6. 能否提供一些具体的错误日志信息或错误码？
  7. 您的OceanBase版本信息是什么？

这些信息对我们定位问题非常有帮助，感谢您的配合！

附上敏捷诊断工具 obdiag 使用帮助链接

4 个赞
#4

这里是不是有点问题，看一下这个通不通

3 个赞
#5

image
image1365×563 50.8 KB

通过 traceid 去 odproxy.log 搜索如下：

[2026-03-17 23:10:55.966473] WARN  [PROXY.SM] handle_server_setup_error (ob_mysql_sm.cpp:8405) [42123][Y0-00007F9C634228A0] [lt=18] [dc=0] trace_log(trans_state_.trace_log_= | dropped=0)
[2026-03-17 23:10:55.966524] INFO  [PROXY.SS] ob_mysql_server_session.cpp:153 [42123][Y0-00007F9C634228A0] [lt=49] [dc=0] server session do_io_close((*this={ss_id:125841684, server_sessid:3223205749, server_ip:{10.145.205.89:2881}, is_inited:true, magic:19136237, state:1, server_vc:0x7f9c6d749120, client_session:{this:0x7f9c6867ce90, is_proxy_mysql_client:false, is_waiting_trans_first_request:false, need_delete_cluster:false, is_first_dml_sql_got:false, vc_ready_killed:false, active:true, magic:19132429, conn_decrease:true, current_tid:42123, cs_id:40195, proxy_sessid:13882479996272112568, session_info:{is_inited:true, priv_info:{has_all_privilege:false, cs_id:40195, user_priv_set:0, cluster_name:"catl_cloudDB_JC", tenant_name:"ROSE_JC", user_name:"a_rose_jc"}, version:{common_hot_sys_var_version:0, common_sys_var_version:0, mysql_hot_sys_var_version:0, mysql_sys_var_version:0, hot_sys_var_version:0, sys_var_version:12, user_var_version:1, db_name_version:1, last_insert_id_version:0, sess_info_version:6}, hash_version:{common_hot_sys_var_version:0, common_sys_var_version:0, mysql_hot_sys_var_version:0, mysql_sys_var_version:0, hot_sys_var_version:0, sys_var_version:0, user_var_version:0, db_name_version:0, last_insert_id_version:0, sess_info_version:0}, val_hash:{common_hot_sys_var_hash:0, common_cold_sys_var_hash:0, mysql_hot_sys_var_hash:0, mysql_cold_sys_var_hash:0, hot_sys_var_hash:0, cold_sys_var_hash:0, user_var_hash:0}, global_vars_version:0, is_global_vars_changed:false, is_trans_specified:false, is_user_idc_name_set:false, is_read_consistency_set:false, idc_name:"", cluster_id:0, real_meta_cluster_name:"", safe_read_snapshot:1, syncing_safe_read_snapshot:0, route_policy:1, proxy_route_policy:3, user_identity:0, global_vars_version:0, is_read_only_user:false, is_request_follower_user:false, obproxy_force_parallel_query_dop:1, ob20_request:{remain_payload_len:0, ob20_request_received_done:false, ob20_header:{ob 20 protocol header:{compressed_len:0, seq:0, non_compressed_len:0}, magic_num:0, header_checksum:0, connection_id:0, request_id:0, pkt_seq:0, payload_len:0, version:0, flag_.flags:0, reserved:0}}, client_cap:0, server_cap:916303, last_server_addr:{*Not IP address [0]*:0}, last_server_sess_id:0, init_sql:""}, dummy_ldc:{use_ldc:false, idc_name:"", item_count:1, site_start_index_array:[[0]0, [1]1, [2]1, [3]1], item_array:[[0]{idc_type:"SAME_IDC", zone_type:"ReadWrite", replica:{server:"10.145.205.89:2881", is_dup_replica:false, role:"FOLLOWER", type:"FULL"}, is_merging:false, is_partition_server:false, is_force_congested:false, is_used:true}], pl:null, ts:0x7f9c636d0460, readonly_exist_status:"READONLY_ZONE_NOT_EXIST"}, dummy_entry:0x7f9c4979b5b0, server_state_version:31, cur_ss:0x7f9c6d2f8a00, bound_ss:null, lii_ss:null, cluster_resource:{this:0x7f9c60da3080, ref_count:1898, is_inited:true, cluster_info_key:{cluster_name:{config_string:"catl_cloudDB_JC"}, cluster_id:0}, cr_state:"CR_AVAIL", version:2, last_access_time_ns:1773760255965817240, deleting_completed_thread_num:0, fetch_rslist_task_count:0, fetch_idc_list_task_count:0, last_idc_list_refresh_time_ns:1773754905737000234, last_rslist_refresh_time_ns:1716533467463005479, server_state_version:31}, client_vc:0x7f9c634b9cc0, using_ldg:false, trace_stats:NULL}, transact_count:7, server_trans_stat:1, session_info:{cap:916303, ob_server:, version:{common_hot_sys_var_version:0, common_sys_var_version:0, mysql_hot_sys_var_version:0, mysql_sys_var_version:0, hot_sys_var_version:0, sys_var_version:12, user_var_version:1, db_name_version:1, last_insert_id_version:0, sess_info_version:6}, val_hash:{common_hot_sys_var_hash:0, common_cold_sys_var_hash:0, mysql_hot_sys_var_hash:0, mysql_cold_sys_var_hash:0, hot_sys_var_hash:0, cold_sys_var_hash:0, user_var_hash:0}, checksum_switch:1, server_type:1}}, server_vc_=0x7f9c6d749120, this=0x7f9c6d2f8a00)
[2026-03-17 23:10:55.966615] INFO  [PROXY.SS] ob_mysql_server_session.cpp:190 [42123][Y0-00007F9C634228A0] [lt=83] [dc=0] server session is closing(ss_id=125841684, server_sessid=3223205749, server_ip={10.145.205.89:2881}, cs_id=40195, proxy_sessid=13882479996272112568)
[2026-03-17 23:10:55.966639] INFO  [PROXY.TXN] ob_mysql_transact.cpp:5761 [42123][Y0-00007F9C634228A0] [lt=6] [dc=0] [ObMysqlTransact::handle_server_connection_break](client_ip={10.145.199.161:1431}, server_ip={10.145.205.89:2881}, cs_id=40195, proxy_sessid=13882479996272112568, ss_id=0, server_sessid=0, sm_id=181606778, proxy_user_name=a_rose_jc@ROSE_JC#catl_cloudDB_JC, database_name=rosefinch_iam, server_state="INTERNAL_ERROR", request_cmd="Quit", sql_cmd="Quit", sql=)
[2026-03-17 23:10:55.966653] INFO  [PROXY.SM] ob_mysql_sm.cpp:9000 [42123][Y0-00007F9C634228A0] [lt=12] [dc=0] [setup_error_transfer] Now closing connection caused by OB_MYSQL_COM_QUIT(sm_id=181606778, request_cmd="Quit", sql_cmd="Quit", sql=)
[2026-03-17 23:10:55.966661] INFO  [PROXY.SS] ob_mysql_client_session.cpp:652 [42123][Y0-00007F9C634228A0] [lt=3] [dc=0] client session do_io_close((*this={this:0x7f9c6867ce90, is_proxy_mysql_client:false, is_waiting_trans_first_request:false, need_delete_cluster:false, is_first_dml_sql_got:false, vc_ready_killed:false, active:true, magic:19132429, conn_decrease:true, current_tid:42123, cs_id:40195, proxy_sessid:13882479996272112568, session_info:{is_inited:true, priv_info:{has_all_privilege:false, cs_id:40195, user_priv_set:0, cluster_name:"catl_cloudDB_JC", tenant_name:"ROSE_JC", user_name:"a_rose_jc"}, version:{common_hot_sys_var_version:0, common_sys_var_version:0, mysql_hot_sys_var_version:0, mysql_sys_var_version:0, hot_sys_var_version:0, sys_var_version:12, user_var_version:1, db_name_version:1, last_insert_id_version:0, sess_info_version:6}, hash_version:{common_hot_sys_var_version:0, common_sys_var_version:0, mysql_hot_sys_var_version:0, mysql_sys_var_version:0, hot_sys_var_version:0, sys_var_version:0, user_var_version:0, db_name_version:0, last_insert_id_version:0, sess_info_version:0}, val_hash:{common_hot_sys_var_hash:0, common_cold_sys_var_hash:0, mysql_hot_sys_var_hash:0, mysql_cold_sys_var_hash:0, hot_sys_var_hash:0, cold_sys_var_hash:0, user_var_hash:0}, global_vars_version:0, is_global_vars_changed:false, is_trans_specified:false, is_user_idc_name_set:false, is_read_consistency_set:false, idc_name:"", cluster_id:0, real_meta_cluster_name:"", safe_read_snapshot:1, syncing_safe_read_snapshot:0, route_policy:1, proxy_route_policy:3, user_identity:0, global_vars_version:0, is_read_only_user:false, is_request_follower_user:false, obproxy_force_parallel_query_dop:1, ob20_request:{remain_payload_len:0, ob20_request_received_done:false, ob20_header:{ob 20 protocol header:{compressed_len:0, seq:0, non_compressed_len:0}, magic_num:0, header_checksum:0, connection_id:0, request_id:0, pkt_seq:0, payload_len:0, version:0, flag_.flags:0, reserved:0}}, client_cap:0, server_cap:916303, last_server_addr:{*Not IP address [0]*:0}, last_server_sess_id:0, init_sql:""}, dummy_ldc:{use_ldc:false, idc_name:"", item_count:1, site_start_index_array:[[0]0, [1]1, [2]1, [3]1], item_array:[[0]{idc_type:"SAME_IDC", zone_type:"ReadWrite", replica:{server:"10.145.205.89:2881", is_dup_replica:false, role:"FOLLOWER", type:"FULL"}, is_merging:false, is_partition_server:false, is_force_congested:false, is_used:true}], pl:null, ts:0x7f9c636d0460, readonly_exist_status:"READONLY_ZONE_NOT_EXIST"}, dummy_entry:0x7f9c4979b5b0, server_state_version:31, cur_ss:null, bound_ss:null, lii_ss:null, cluster_resource:{this:0x7f9c60da3080, ref_count:1898, is_inited:true, cluster_info_key:{cluster_name:{config_string:"catl_cloudDB_JC"}, cluster_id:0}, cr_state:"CR_AVAIL", version:2, last_access_time_ns:1773760255965817240, deleting_completed_thread_num:0, fetch_rslist_task_count:0, fetch_idc_list_task_count:0, last_idc_list_refresh_time_ns:1773754905737000234, last_rslist_refresh_time_ns:1716533467463005479, server_state_version:31}, client_vc:0x7f9c634b9cc0, using_ldg:false, trace_stats:NULL}, client_vc_=0x7f9c634b9cc0, this=0x7f9c6867ce90)
[2026-03-17 23:10:55.966735] INFO  [PROXY.CS] ob_mysql_client_session.cpp:94 [42123][Y0-00007F9C634228A0] [lt=46] [dc=0] client session destroy(cs_id=40195, proxy_sessid=13882479996272112568, client_vc=NULL)
[2026-03-17 23:10:55.966761] INFO  [PROXY.SM] ob_mysql_sm.cpp:9653 [42123][Y0-00007F9C634228A0] [lt=7] [dc=0] deallocating sm(sm_id=181606778)
[2026-03-17 23:10:56.038804] INFO  [PROXY.NET] ob_mysql_session_accept.cpp:36 [42150][Y0-00007F9C634228A0] [lt=8] [dc=0] [ObMysqlSessionAccept:main_event] accepted connection(netvc=0x7f9c634b9cc0, client_ip={127.0.0.1:51100})
[2026-03-17 23:10:56.038843] INFO  [PROXY.NET] ob_unix_net_vconnection.cpp:1255 [42150][Y0-00007F9C634228A0] [lt=18] [dc=0] vip connect(protocol=6, fd=1010, vid=0, vaddr={127.0.0.1:2883}, caddr={127.0.0.1:51100}, daddr={127.0.0.1:2883})
[2026-03-17 23:10:56.038864] INFO  [PROXY.CS] ob_mysql_client_session.cpp:370 [42150][Y0-00007F9C634228A0] [lt=12] [dc=0] client session born(cs_id=1344019, proxy_sessid=0, is_local_connection=true, client_vc=0x7f9c634b9cc0, client_fd=1010, client_addr="127.0.0.1:51100")
[2026-03-17 23:10:56.038886] INFO  [PROXY.CS] ob_mysql_client_session.cpp:241 [42150][Y0-00007F9C634228A0] [lt=10] [dc=0] Starting new transaction using sm(cs_id=1344019, get_transact_count()=0, sm_id=181644326)
[2026-03-17 23:10:56.038896] INFO  [PROXY.SM] ob_mysql_sm.cpp:521 [42150][Y0-00007F9C634228A0] [lt=7] [dc=0] the request already in buffer, continue to handle it(buffer len=0, is_auth_rquest=true)
[2026-03-17 23:10:56.038902] WARN  [PROXY] get_cluster_name (ob_session_field_mgr.cpp:617) [42150][Y0-00007F9C634228A0] [lt=4] [dc=0] fail to get cluster name(ret=-4018)
[2026-03-17 23:10:56.038912] WARN  [PROXY] get_tenant_name (ob_session_field_mgr.cpp:629) [42150][Y0-00007F9C634228A0] [lt=10] [dc=0] fail to get tenant name(ret=-4018)
[2026-03-17 23:10:56.039008] WARN  [PROXY.SM] tunnel_handler_client (ob_mysql_sm.cpp:6032) [42150][Y0-00007F9C634228A0] [lt=9] [dc=0] ObMysqlSM::tunnel_handler_client(event="VC_EVENT_EOS", sm_id=181644326)
[2026-03-17 23:10:56.039018] WARN  [PROXY.SM] set_client_abort (ob_mysql_sm.cpp:8124) [42150][Y0-00007F9C634228A0] [lt=9] [dc=0] client will abort soon(sm_id=181644326, cs_id=1344019, proxy_sessid=0, ss_id=0, server_sessid=0, client_ip={127.0.0.1:51100}, server_ip={*Not IP address [0]*:0}, cluster_name=, tenant_name=, user_name=, db=, event="VC_EVENT_EOS", request_cmd="Sleep", sql_cmd="Delete session", sql=OB_MYSQL_COM_HANDSHAKE)
[2026-03-17 23:10:56.039043] INFO  [PROXY.SM] ob_mysql_sm.cpp:9534 [42150][Y0-00007F9C634228A0] [lt=4] [dc=0] will deallocate sm(sm_id=181644326, pending_action=NULL, api_.callout_state=0, trans_state_.trace_log= | dropped=0)
[2026-03-17 23:10:56.039049] INFO  [PROXY.SS] ob_mysql_client_session.cpp:652 [42150][Y0-00007F9C634228A0] [lt=5] [dc=0] client session do_io_close((*this={this:0x7f9c5dd069a0, is_proxy_mysql_client:false, is_waiting_trans_first_request:false, need_delete_cluster:false, is_first_dml_sql_got:false, vc_ready_killed:false, active:true, magic:19132429, conn_decrease:true, current_tid:42150, cs_id:1344019, proxy_sessid:0, session_info:{is_inited:true, priv_info:{has_all_privilege:false, cs_id:4294967295, user_priv_set:-1, cluster_name:"", tenant_name:"", user_name:""}, version:{common_hot_sys_var_version:0, common_sys_var_version:0, mysql_hot_sys_var_version:0, mysql_sys_var_version:0, hot_sys_var_version:0, sys_var_version:0, user_var_version:0, db_name_version:0, last_insert_id_version:0, sess_info_version:0}, hash_version:{common_hot_sys_var_version:0, common_sys_var_version:0, mysql_hot_sys_var_version:0, mysql_sys_var_version:0, hot_sys_var_version:0, sys_var_version:0, user_var_version:0, db_name_version:0, last_insert_id_version:0, sess_info_version:0}, val_hash:{common_hot_sys_var_hash:0, common_cold_sys_var_hash:0, mysql_hot_sys_var_hash:0, mysql_cold_sys_var_hash:0, hot_sys_var_hash:0, cold_sys_var_hash:0, user_var_hash:0}, global_vars_version:-1, is_global_vars_changed:false, is_trans_specified:false, is_user_idc_name_set:false, is_read_consistency_set:false, idc_name:"", cluster_id:-1, real_meta_cluster_name:"", safe_read_snapshot:0, syncing_safe_read_snapshot:0, route_policy:1, proxy_route_policy:3, user_identity:0, global_vars_version:-1, is_read_only_user:false, is_request_follower_user:false, obproxy_force_parallel_query_dop:1, ob20_request:{remain_payload_len:0, ob20_request_received_done:false, ob20_header:{ob 20 protocol header:{compressed_len:0, seq:0, non_compressed_len:0}, magic_num:0, header_checksum:0, connection_id:0, request_id:0, pkt_seq:0, payload_len:0, version:0, flag_.flags:0, reserved:0}}, client_cap:0, server_cap:0, last_server_addr:{*Not IP address [0]*:0}, last_server_sess_id:0, init_sql:""}, dummy_ldc:{use_ldc:false, idc_name:"", item_count:0, site_start_index_array:[[0]0, [1]0, [2]0, [3]0], item_array:null, pl:null, ts:null, readonly_exist_status:"READONLY_ZONE_UNKNOWN"}, dummy_entry:null, server_state_version:0, cur_ss:null, bound_ss:null, lii_ss:null, cluster_resource:NULL, client_vc:0x7f9c634b9cc0, using_ldg:false, trace_stats:NULL}, client_vc_=0x7f9c634b9cc0, this=0x7f9c5dd069a0)
[2026-03-17 23:10:56.039103] INFO  [PROXY.CS] ob_mysql_client_session.cpp:94 [42150][Y0-00007F9C634228A0] [lt=52] [dc=0] client session destroy(cs_id=1344019, proxy_sessid=0, client_vc=NULL)
[2026-03-17 23:10:56.039114] INFO  [PROXY.SM] ob_mysql_sm.cpp:9653 [42150][Y0-00007F9C634228A0] [lt=3] [dc=0] deallocating sm(sm_id=181644326)
[2026-03-17 23:10:56.064915] INFO  [PROXY.NET] ob_mysql_session_accept.cpp:36 [42149][Y0-00007F9C634228A0] [lt=6] [dc=0] [ObMysqlSessionAccept:main_event] accepted connection(netvc=0x7f9c634b9cc0, client_ip={10.145.201.146:44366})
[2026-03-17 23:10:56.064934] INFO  [PROXY.NET] ob_unix_net_vconnection.cpp:1255 [42149][Y0-00007F9C634228A0] [lt=10] [dc=0] vip connect(protocol=6, fd=1004, vid=0, vaddr={10.145.201.146:2883}, caddr={10.145.201.146:44366}, daddr={10.145.205.103:2883})
3 个赞
#6

没有明白 什么迁移租户到新物理机上 把具体的操作 可以截图说一下

2 个赞
#7

通的 ，这个是业务的 jdbc ，没改动过。
我这边只做过 unit 迁移，odp 我都没动

3 个赞
#8

就是集群扩容，新加了3台大规格物理机，我手动把租户迁移到大规格物理机上。

3 个赞
#9

你是通过租户扩缩容的方式 弄的么？还是怎么弄的

3 个赞
#10

就是 物理机替换虚拟机，把租户全部掐你遇到物理机上，等没问题 在把虚拟机删除掉。

3 个赞
#11

那具体你怎么迁移租户的呢？这个我有点不明白

2 个赞
#12

新物理机上部署了obproxy吗，且三台新机器上的obproxy后端ip添加到 vip了吗

3 个赞
#13

把obproxy.error obproxy.log obproxy_diagnosis.log 日志都发一下

1 个赞
#14

部署了，但是 没有 启用。

1 个赞
#15

tenant unit merge ，从一个节点迁移到另外一个节点。

1 个赞
#16

我发现一个可疑点

odp : 83

MySQL [(none)]> show proxycluster \G
*************************** 1. row ***************************
cluster_name: catl_cloudDB_JC
  cluster_id: 0
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JC&version=2
   root_addr: 0.0.0.0:0
        role: follower
replica_type: FULL
*************************** 2. row ***************************
cluster_name: catl_cloudDB_JCEICS
  cluster_id: 40
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JCEICS&version=2
   root_addr: 10.145.205.128:2881
        role: leader
replica_type: FULL
*************************** 3. row ***************************
cluster_name: catl_cloudDB_JCEICS
  cluster_id: 40
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JCEICS&version=2
   root_addr: 10.145.205.129:2881
        role: follower
replica_type: FULL
*************************** 4. row ***************************
cluster_name: catl_cloudDB_JCEICS
  cluster_id: 40
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JCEICS&version=2
   root_addr: 10.145.205.130:2881
        role: follower
replica_type: FULL
*************************** 5. row ***************************
cluster_name: MetaDataBase
  cluster_id: 0
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=obdv1&version=2
   root_addr: 0.0.0.0:0
        role: follower
replica_type: FULL
5 rows in set (0.00 sec)

MySQL [(none)]> show proxycluster \G
*************************** 1. row ***************************
cluster_name: catl_cloudDB_JC
  cluster_id: 0
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JC&version=2
   root_addr: 0.0.0.0:0
        role: follower
replica_type: FULL
*************************** 2. row ***************************
cluster_name: catl_cloudDB_JCEICS
  cluster_id: 40
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JCEICS&version=2
   root_addr: 10.145.205.128:2881
        role: leader
replica_type: FULL
*************************** 3. row ***************************
cluster_name: catl_cloudDB_JCEICS
  cluster_id: 40
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JCEICS&version=2
   root_addr: 10.145.205.129:2881
        role: follower
replica_type: FULL
*************************** 4. row ***************************
cluster_name: catl_cloudDB_JCEICS
  cluster_id: 40
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JCEICS&version=2
   root_addr: 10.145.205.130:2881
        role: follower
replica_type: FULL
*************************** 5. row ***************************
cluster_name: MetaDataBase
  cluster_id: 0
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=obdv1&version=2
   root_addr: 0.0.0.0:0
        role: follower
replica_type: FULL
5 rows in set (0.00 sec)

odp ：82

[root@cajcpobs02 ~]#  mysql -uroot@proxysys -h10.145.xxx.xx -P2883  -p'xxxx'
Welcome to the MariaDB monitor.  Commands end with ; or \g.
Your MySQL connection id is 844978
Server version: 8.0.30

Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

MySQL [(none)]> show proxycluster \G
*************************** 1. row ***************************
cluster_name: catl_cloudDB_JC
  cluster_id: 6
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JC&version=2
   root_addr: 10.145.205.91:2881
        role: leader
replica_type: FULL
*************************** 2. row ***************************
cluster_name: catl_cloudDB_JC
  cluster_id: 6
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JC&version=2
   root_addr: 10.145.205.82:2881
        role: follower
replica_type: FULL
*************************** 3. row ***************************
cluster_name: catl_cloudDB_JC
  cluster_id: 6
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JC&version=2
   root_addr: 10.145.205.87:2881
        role: follower
replica_type: FULL
*************************** 4. row ***************************
cluster_name: catl_cloudDB_JC
  cluster_id: 6
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JC&version=2
   root_addr: 10.145.205.81:2881
        role: leader
replica_type: FULL
*************************** 5. row ***************************
cluster_name: catl_cloudDB_JC
  cluster_id: 6
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JC&version=2
   root_addr: 10.145.205.86:2881
        role: follower
replica_type: FULL
*************************** 6. row ***************************
cluster_name: catl_cloudDB_JC
  cluster_id: 6
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JC&version=2
   root_addr: 10.145.205.90:2881
        role: follower
replica_type: FULL
*************************** 7. row ***************************
cluster_name: catl_cloudDB_JC
  cluster_id: 6
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JC&version=2
   root_addr: 10.145.205.85:2881
        role: leader
replica_type: FULL
*************************** 8. row ***************************
cluster_name: catl_cloudDB_JC
  cluster_id: 6
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JC&version=2
   root_addr: 10.145.205.89:2881
        role: follower
replica_type: FULL
*************************** 9. row ***************************
cluster_name: catl_cloudDB_JC
  cluster_id: 6
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JC&version=2
   root_addr: 10.145.205.93:2881
        role: follower
replica_type: FULL
*************************** 10. row ***************************
cluster_name: catl_cloudDB_JC
  cluster_id: 6
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JC&version=2
   root_addr: 10.145.205.88:2881
        role: leader
replica_type: FULL
*************************** 11. row ***************************
cluster_name: catl_cloudDB_JC
  cluster_id: 6
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JC&version=2
   root_addr: 10.145.205.92:2881
        role: follower
replica_type: FULL
*************************** 12. row ***************************
cluster_name: catl_cloudDB_JC
  cluster_id: 6
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JC&version=2
   root_addr: 10.145.205.83:2881
        role: follower
replica_type: FULL
*************************** 13. row ***************************
cluster_name: catl_cloudDB_JCEICS
  cluster_id: 40
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JCEICS&version=2
   root_addr: 10.145.205.128:2881
        role: leader
replica_type: FULL
*************************** 14. row ***************************
cluster_name: catl_cloudDB_JCEICS
  cluster_id: 40
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JCEICS&version=2
   root_addr: 10.145.205.129:2881
        role: follower
replica_type: FULL
*************************** 15. row ***************************
cluster_name: catl_cloudDB_JCEICS
  cluster_id: 40
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=catl_cloudDB_JCEICS&version=2
   root_addr: 10.145.205.130:2881
        role: follower
replica_type: FULL
*************************** 16. row ***************************
cluster_name: MetaDataBase
  cluster_id: 0
      rs_url: http://172.18.46.52:8080/services?Action=ObRootServiceInfo&User_ID=alibaba&UID=test&ObRegion=obdv1&version=2
   root_addr: 0.0.0.0:0
        role: follower
replica_type: FULL
16 rows in set (0.01 sec)
#17

之前看报错的信息 cluster集群信息 tenant租户信息 看着是查询有问题
[2026-03-17 23:10:56.038902] WARN [PROXY] get_cluster_name (ob_session_field_mgr.cpp:617) [42150][Y0-00007F9C634228A0] [lt=4] [dc=0] fail to get cluster name(ret=-4018)
[2026-03-17 23:10:56.038912] WARN [PROXY] get_tenant_name (ob_session_field_mgr.cpp:629) [42150][Y0-00007F9C634228A0] [lt=10] [dc=0] fail to get tenant name(ret=-4018)

#18

odp 83 节点，rs信息 不完整，这个怎么解决？还是要重启83 odp ?

1 个赞
#19

这个问题是不是这样的 ?
83 odp rs信息不完整，如果通过 config_url 拿不到rs 信息 就回去本地 obproxy_config_server_info.json 去获取，这个是本地的缓存信息，不过信息是老旧的。
正好这次做了新增 observer ，这个文件是旧的 就找不到源数据信息和租户、集群等信息，就报错。

1 个赞
#20

这个案例讨论挺有激烈的

#21

你查看一下obproxy_rslist_info.json这个文件的信息 目前rs list是否有问题
obproxy_config_server_url这个配置项的信息 也查看一下