【 使用环境 】测试环境
【 OB or 其他组件 】OB及附加组件
【 使用版本 】4.2.2
【问题描述】在主控机通过OBD重启集群,在OCP的集群监控界面,数据库性能无数据。
【复现路径】多次在主控机通过OBD重启集群,均显示成功,但OCP的集群监控界面,数据库性能部分依然无数据,主机性能部分监控数据正常。尝试更新过OCP租户的连接白名单,对该问题无效果。
【附件及日志】
OCP Express日志的ERROR部分:
2024-01-30 10:52:12.071 WARN 106767 — [pool-prometheus-second-schedule-1,cc612742105c] o.h.engine.jdbc.spi.SqlExceptionHelper : SQL Error: 0, SQLState: null
2024-01-30 10:52:12.071 ERROR 106767 — [pool-prometheus-second-schedule-1,cc612742105c] o.h.engine.jdbc.spi.SqlExceptionHelper : wait millis 2000, active 1, maxActive 100, creating 0, createErrorCount 16
2024-01-30 10:52:12.087 ERROR 106767 — [pool-prometheus-second-schedule-1,cc612742105c] c.o.ocp.monitor.OcpMonitorManager : collect schedule failed
org.springframework.orm.jpa.JpaSystemException: Unable to acquire JDBC Connection; nested exception is org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection
at org.springframework.orm.jpa.vendor.HibernateJpaDialect.convertHibernateAccessException(HibernateJpaDialect.java:331) ~[spring-orm-5.3.27.jar!/:5.3.27]
at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:233) ~[spring-orm-5.3.27.jar!/:5.3.27]
at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:551) ~[spring-orm-5.3.27.jar!/:5.3.27]
at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:61) ~[spring-tx-5.3.27.jar!/:5.3.27]
at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:242) ~[spring-tx-5.3.27.jar!/:5.3.27]
at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:152) ~[spring-tx-5.3.27.jar!/:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.3.27.jar!/:5.3.27]
at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:145) ~[spring-data-jpa-2.7.12.jar!/:2.7.12]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.3.27.jar!/:5.3.27]
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) ~[spring-aop-5.3.27.jar!/:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.3.27.jar!/:5.3.27]
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:220) ~[spring-aop-5.3.27.jar!/:5.3.27]
at com.sun.proxy.$Proxy195.findAllByStatus(Unknown Source) ~[na:na]
at com.oceanbase.ocp.monitor.service.ExporterServiceImpl.getAllActiveExporters(ExporterServiceImpl.java:85) ~[ocp-express-monitor-service-4.2.2-20240108.jar!/:4.2.2-20240108]
at com.oceanbase.ocp.monitor.service.ExporterServiceImpl$$FastClassBySpringCGLIB$$d0a3dbc9.invoke() ~[ocp-express-monitor-service-4.2.2-20240108.jar!/:4.2.2-20240108]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.3.27.jar!/:5.3.27]
at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) ~[spring-aop-5.3.27.jar!/:5.3.27]
at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) ~[spring-aop-5.3.27.jar!/:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) ~[spring-aop-5.3.27.jar!/:5.3.27]
at com.oceanbase.ocp.monitor.service.ExporterServiceImpl$$EnhancerBySpringCGLIB$$f0c32a05.getAllActiveExporters() ~[ocp-express-monitor-service-4.2.2-20240108.jar!/:4.2.2-20240108]
at com.oceanbase.ocp.monitor.OcpMonitorManager$CollectSecondTask.run(OcpMonitorManager.java:152) ~[ocp-express-monitor-service-4.2.2-20240108.jar!/:4.2.2-20240108]
at com.oceanbase.ocp.common.util.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:29) [ocp-express-common-4.2.2-20240108.jar!/:4.2.2-20240108]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_392]
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) ~[na:1.8.0_392]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_392]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ~[na:1.8.0_392]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_392]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_392]
at java.lang.Thread.run(Thread.java:750) ~[na:1.8.0_392]
Caused by: org.hibernate.exception.GenericJDBCException: Unable to acquire JDBC Connection
at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:47) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final]
at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:113) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final]
at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:99) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final]
at org.hibernate.resource.jdbc.internal.LogicalConnectionManagedImpl.acquireConnectionIfNeeded(LogicalConnectionManagedImpl.java:111) ~[hibernate-core-5.4.28.Final.jar!/:5.4.28.Final]
…………
OCP的相关截图: